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PEEFACE 


There is a pronounced need of a book on advanced calculus that 
does not sacrifice rigor to such an extent as to become ineffectual 
, as an instrument for developing a critical attitude toward analyti- 
cal processes, and yet which is sufficiently concrete to be useful 
to a student with one year of preparation in the calculus. I am 
under no delusion that this volume completely fills this need, 
and I shall feel generously repaid for my efforts if it should prove 
of some aid to those wffio are faced wdth the perplexing problem 
of instruction in analysis. 

In preparing this book I have made every effort to keep in 
mind the difficulties of the reader wffio is encountering for the 
first time a serious body of mathematical doctrine. Some ideas 
that are innately difficult, but whose basic sources stem from 
geometry, are presented first from an intuitive point of view, 
so that the essentials can be grasped at once. I did not think 
it wise to include rigorous arithmetical proofs of such theorems 
as those on convergence of bounded monotone sequences (See. 6), 
the theorem of Bolzano-Weierstrass (Sec. 7), the theorem of 
Darboux (Sec. 35), and a few others. This is in accordance with 
the precept that the most effective nfeans of thwarting interest 
in mathematics is by misdirecting rigor. A reader who is suffi- 
ciently sophisticated to feel the need of arithmetical proofs of 
these theorems will find them in the treatises to which I refer 
in the text. The material contained in this volume is so arranged 
as to minimize the need of irksome references to matters to be 
established later on. No difficult and essential proofs have been 
relegated to exercises to be worked out at the reader’s leisure. 

The subject of advanced calculus is not an easy one, and the 
working, of the problems is essential to a mastery. There are 
numerous illustrative exercises and problems scattered through- 
out the text to aid the reader in gaining an insight into the beauty 
and the wide range of applications of analysis. A student with 
a good background in the calculus will be able to read this book 
without omissions. 



VI 


PREFACE 


A considerable portion of the material included here represents 
a transcription of the lecture notes that I have used from time to 
time in my classes. These notes place me under some obligation 
to many of the existing books on analysis, especially to the 
masterpieces of Goursat, Knopp, and de la Vallee Poussin. I 
am also much indebted to my wife, who not only undertook the 
arduous task of reading the manuscript in its various stages, but 
who also aided me immeasurably with the correction of the proof. 
Her assistance has resulted in many essential improvements. 


Madison, Wis., 
November j 1939. 


Ivan S. Sokolnikofx. 
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CHAPTER I 

LIMITS AND CONTINUITY 

1. Number System. This section consists of a brief summary 
of the concepts and properties of the system of numbers that will 
be considered in this volume. The starting point is the system 
of positive integers. This system permits the operations of 
addition and multiplication but proves inadequate to permit 
the solution of many simple linear equations. Thus, if o, b, 
c, and d are positive integers, a + x = b and q/ = d do not 
possess solutions that are positive integers unless b > a and d is 
an integral multiple of c. The first equation serves as the defini- 
tion of the new number zero if 6 = a and of the negative integers 
if 6 < a. The second equation demands the introduction of 
d 

the fractional numbers — 
c 

The system of numbers consisting of the positive and negative 
integers and fractions and zero is called the system of rational 
numbers. It admits the four fundamental operations of addition, 
subtraction, multiplication, and division (except by zero) . More- 
over, it is “ ordered,” which means that if a and b are two different 
numbers, then a > b ov b > a. Also, if c is a third rational 
number and a > b and b > c, then a > c. The system of 
rational numbers possesses the additional property of density, that 
is, between any two different rational numbers there is always 
another rational number (and, therefore, an infinite number of 
rational numbers) that is greater than one of the numbers and 
less than the other. 

A further extension of the number system is required when it 
becomes necessary to solve equations of the second and higher 
degrees. In elementary algebra a rational number is defined as 

one that can be expressed in the form (& 0), where a and b 

I 
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are integers, and an irrational number is defined as one that does 
not possess this property. The irrational numbers include not 
only such numbers as •\/2, ->^3, etc., which arise in the 

solution of algebraic equations, but also tt, e, etc. The method of 
introducing the irrational numbers, which is outlined below, is due 
to Dedekind. 

Assume that all the rational numbers have been separated into . 
two sets in such a manner that every number in the first set is 
less than every number in the second set. A separation of this 
type is called a cut, or partition, (French, coupure; German, 
Schnitt) of the number system. Four cases present themselves, 
but it is easy to see that one of these is impossible. They are : 

i. The first set, A, contains a greatest element a and the second 
set, B, contains a smallest element h. It cannot be that a = b 
since every element of A is less than every element of B. But 
if a < 6, then there are rational numbers which are greater than 
a and less than b (by the property of density). These numbers, 
being greater than a, must belong to B, and at the same time, 
being less than h, must belong to A, which is impossible. 

ii. A contains a greatest element a, and B contains no smallest 
element. For example, let A consist of the number 2 and all 
rational numbers less than 2, whereas B consists of all rational 
numbers greater than 2. 

iii. B contains a smallest element h, and A contains no greatest 
element. For example, let B contain 2 and all rational numbers 
greater than 2, and A contain all rational numbers less than 2. 

iv. A contains no greatest element, and B contains no smallest 
element. For example, let A consist of all the negative rational 
numbers and all positive rational numbers whose square is less 
than 2, and let B consist of all the positive rational numbers whose 
square is greater than 2. Then the cut defines the irrational 
number \/2* In general, let the system of rational numbers be 
separated into two sets A and B in such a way that every number 
in A is less than every number in B and A contains no greatest 
element and B contains no smallest element. Then the cut defines 
an irrational number that has the property of being greater than 
all the elements in A and less than all the elements in B, 

The system of numbers that includes all the rational numbers 
and all the irrational numbers is called the rml number system. 

* Stetigkeit und irrationale Zahlen, Braunschweig, 1872. 
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The fundamental operations of addition and multiplication and 
the inverse operations of subtraction and division are defined for 
irrational numbers in such a way* that the system of real numbers 
possesses the commutative, associative, and distributive prop- 
erties. Moreover, if the product of any two real numbers is 
zero, then at least one of the numbers must be zero. 

It is often desirable to have a correspondence between the 
real numbers and the points of a straight line, so that analytic 
methods can be applied to geometry. In order to effect a one-to- 
one correspondence, it is necessary to assume the axiom of Cantor- 
Dedekind, which states that ^To each point on the line there 
corresponds one and only one real number and, conversely, to 
each real number there corresponds one and only one point on the 
line.’’ 

As is already familiar from elementary’' algebra, the solution 
of the general quadratic equation ax^ + bx + c 0, in the case 
where the discriminant b^ — 4ac is negative, necessitates the 
introduction of a new type of number of the form u + iv, where u 
and V are real numbers and i is 'a number such that i^ — — 1. 
Such numbers are called complex numbers. The system of com- 
plex numbers includes the system of real numbers (as a. special 
case when y = 0), and the fundamental operations must be 
defined so that they are consistent with those already in use for 
real numbers. This can be done by considering the complex 
numbers in the form u + iv or by treating them as ordered pairs 
{u, v) of real numbers. Since this volume deals primarily with 
real numbers, these definitions and the properties of complex 
numbers will not be discussed here.f 

2. Sequences, Let some process of construction yield a 
succession of real numbers 

^ 1 , ^ 2 , Xs, • * Xnj * ^ , 

where it is assumed that every term Xi is followed by other terms. 
A succession of numbers formed in this way is called a sequence 

* De la Vall^se Poussin, C. J., Cours d’analyse infinitesimale, vol. 1, 
pp. 1-8; Fine, H. B., College Algebra, pp. 39-55; Hobson, E. W., Theory of 
Functions of a Real Variable, vol. 1, pp. 20-34. 

t See De la Vallee Poussin, C. J., Cours d’analyse infinitesimale, 
vol. 1, pp. 37-42; Fine, H. B., College Algebra, pp. 70-78; Burkhardt, H., 
and Rasor, S. E., Theory of Functions of a Complex Variable, pp. 1-23. 
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and is denoted by the symbol [xi]. The individual terms of the 
sequence {xi} are called the elements of the sequence. 

Examples of sequences are 


(а) 1, 2, 3, 4, . . . 

(б) 1, --2, 3, -4, ■ 

, , 1 11 1 

2 ' 4 ' 8 ' 16 ' 


n, 




id) 0, 1, 0, 1, • • • , H[1 + (-1)"], • • 
(e) 2, 3, 5, 7, 11, • ‘ • , Pm • • • . 




It is not essential that the general term of the sequence be given 
by some simple formula, as is the case in the first four examples 
above. The sequence {e) represents the succession of prime num- 
bers, and pn stands for the nth prime number. There is no 
formula available for the determination of the nth prime number, 
but it is possible to calculate all prime numbers less than any 
given number N. Although the process of constructing the 


P3 

-4- 


Pz Pa Pi 

-X 1 ^ ^ 

O Xx Xg XI 

Fig. 1. 


sequence (e) is much more complicated than the processes used 
for the other examples, nevertheless it yields a definite succession 
of numbers. 

It is convenient to represent the elements Xi of the sequence 
{a;t} by points Pi on a straight line. The points Pi are so chosen 
that the distance from an arbitrary point 0 of the line to the 
point Pi is equal to Xi. In this way a correspondence is estab- 
lished between the elements of the sequence {xi} and a set of 
points on a straight line. To avoid circumlocution, the elements 
Xi of the sequence will be called points, instead of saying that they 
are numbers such that the distances of the points Pi corresponding 
to them, from some fiducial point 0, are equal to Xi (Fig. 1). 

In studying the behavior of sequences of real numbers, or sets 
of points corresponding to them, several interesting cases present 
themselves. It may happen that one can find a positive number 
M such that the inequality 

la:.! < M 
or 

— M < Xn ^ M 
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is satisfied for every n, however large. In such a case the 
sequence is said to be hounded. A geometrical interpreta- 
tion of this circumstance is that the points Pi corresponding to the 
elements of the sequence always remain within a segment of 
length 2M with the point 0 as the midpoint of the segment. 

As an example, consider a succession of values 


12 3 4 

2' 3' 4' 5' 


(- 1 ) 


n— 1 


n 


It is clear that, no matter how large n is taken, 


\Xn\ 


n 

n + 1 


< 1, 


so that the sequence < ( — 1)^ 


n 


i}' 


is bounded. 


n + 

The sequences (a), (6), and {e) (p. 4) are unbounded, but 
any number greater than or equal to 3^ will serve as a bound for 
the sequence (c), and any number greater than or equal to unity 
is a bound for {d). 

A sequence {rci} is called a null sequence if subsequent to the choice 
of a positive number e, however small, one can find a positive integer p 
such that \xn\ < efor all values of n > p. 

If a graphical mode of representing the sequence by points 
on a straight line be adopted, the definition of the null sequence 
means that the points Pp+i, • • • ? corresponding to Xp+i, 

Xp+ 2 , . . • , will all lie within the interval of width 2e with the 
point 0 as midpoint. 

It is important to observe that the integer p in the foregoing 
definition is determined after the choice of the number e has been 
made, and hence, p depends on the magnitude of e. To clarify 


this, consider the sequence 


fe}. 


or 


111 

12' 2^' 3^' 


n^ 


This sequence is a null sequence, since one can always find an 
integer p such that for all values of n greater than 2 ? 

1 . 
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or 


> 


Hence, if one chooses for p any positive integer greater than the 
number the inequality will be satisfied. If e is chosen as 


3d^00; integer greater than 10 will serve as p; but if < 
p must be chosen greater than 100. 


1 


10 , 000 ' 


PROBLEMS 


1. Show that - > is a null sequence. 


2. Prove that 


is a null sequence. 
1 


Show that n must be 


chosen ' greater than logio^ in order that the inequality \xn\ < e be 
satisfied. 

3. Limit of a Sequence. Convergence. If {xi} is a given 
sequence and there exists a number L such that the sequence {xi — L] 
is a null sequence, then the given sequence is said to ha convergent and 
the elements Xi of the sequence are said to approach the limit L. 

Recalling the definition of the null sciquonce, it is clear that if 
the limit of the sequence {xi] is L, then corresponding to any 
positive number e, a positive integer p can be assigned such that 

l-b — a^nl < €, for all n > p. 

The last statement is frequently written in the following ways: 

lim Xn = L, 


or 


Xji ■ > L, 

,,when n oo . The symbol n is read “n tends to infinity.” 
/ It is clear that a null sequence is a convergent sequence with 
the value zero as the limit of the sequence. Moreover, it i.s obvi- 
ous that every convergent sequence is bounded. * 

*The converse of this statement is not true. Thu.s, the seqnence 
0, 1, 0, 1, 0, , . . is bounded but not convergent. 



§3 


LIMITS AND CONTINUITY 


The following theorem regarding null sequences is established 
easily: 

Theorem. If the terms of any null sequence 

^ 2 } ^3; * * * J • • • 

are multiplied by a sequence of bounded factors 

aij a2, azj * j an, • • * j 

then the resulting sequence 

* ‘ * • * 

is a null sequence. 

Since the numbers a-n are bounded, there exists a positive num- 
ber M, independent of n, such that 

(3-1) M. 

Moreover, since the sequence {xi} is a null sequence, it is possible 
to find for every € > 0 a positive integer p such that 

(3-2) \Xn\ < 

whenever n > p, Multipl 3 dng the inequalities (3-1) and (3-2) 
gives 

which establishes the fact that the sequence {anXn} is a null 
sequence. 

Inasmuch as the notion of the limit of a sequence is one of the 
basic concepts of analysis, it is desirable to consider an example. 

Illustrative Example. Let the variable x assume a set of 
values 

Xi = 0.3, X2 = 0.33, Xz = 0.333, - • • . 

It will be shown that 

lim Xn = 

n— + 00 

that is, corresponding to an arbitrary e > 0, one can determine 
a positive integer p, such that the difference 
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\L Xn\ {3^ Xn\ 

becomes and remains less than € for all values of n > p. 

Note that 

-~j_ _ 1 

3 30’ 3 300’ ■ ■ ■ ' 3 ~ 3^’ 

Now choose an e, and impose the demand that 

1 _ _ 1 . 

3 3 • 10” ^ 

But the inequality is equivalent to 

3 • 10” > 

e 

and taking logarithms to the base 10 of both sides of this inequality 
gives* 


log 3 + n > log 


1 


or 

n > — (log 6 + log 3) = — log : 

Thus, if p is chosen as any integer greater than |— log 3e|, the 
inequality will be satisfied for all values of n greater than this 
particular value of p. 

A geometrical interpretation of the statement 
lim Xn = L 

72,*"^ 00 

is that all but a finite number of the points Xi will fall within 
the interval of width 2e about the point L. 

The totality of points whose distance from a given point L is 
less than a given number e is called a neighborhood of this point. 
The term vicinity is also used to denote the neighborhood. 

4. Inequality of Bernoulli- lim 'v/a = 1. Let it be required 

to determine the limit of as co by assuming the sequence 
of positive integral values and where a is any positive number. 

* It will be noted that if ^ log A > log B. This fact follows directly 
from the definition of the logarithm, 
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This limit will be determined with the aid of an inequality estab- 
lished by James Bernoulli, which states that if x is any real num- 
ber such that 

X > —1 and X 9 ^ 0, 

then 

(1 + xY > 1 + nXy 

where n is any integer greater than unity. 

This inequality is obviously true if n = 2, since 

(1 + xY = I + 2x + x^ > 1 + 2x. 

The proof for any positive integral value of n will be established 
by the method of mathematical induction. Assume that the 
inequality is true for n = k, and prove that then it is valid for 
n = k + 1. Since the inequality is known to be true for n = 2, 
it will follow that it is true for n = 3, 4, 5, • • • . 

Assuming the truth of the inequality for n = k, that is, 

(1 + a;)* > 1 + kxj 

then 

(1 -h xY{l +x) > (1+ kx){l + a;) = 1 + (A; + + kx^ 

>1 + (k + l)x, 

and the proof is complete. 

To show that lim = 1 for a > 0, consider the two cases: 
00 

L a > 1, 

ii. 0 < a < 1. 

i. If a = 1, the statement is obvious. 

If a > 1, > 1, so that one can write it as 

(4-1) = 1 -h a:„. 

Hence, 

a = (1 + XnY, 

and by the inequality of Bernoulli 


a = (1 -f XnY > 1 + nxn > nxn- 
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§6 


Consequently, 

a:„ < 

so that the numbers Xn form a null sequence, and it is seen from 
(4-1) that the sequence of numbers 

^ n— >00. 

ii. If 0 < a < 1, then - > 1, and from (i) it follows that 
’ a ' 

(^-2) Wi - 4 

is a null sequence. If the terms of the sequence (4-2) are multi- 
plied by the factors 

a, y/a, -^a, ■ ■ ■ , ^a, ■ ■ ■ , 

there results the sequence 


which, by the theorem of Sec. 3, is a null sequence since the factors 
are bounded. * 


PROBLEM 

Find the limits of the following sequences: 


, . _ 1 2 3 n-- I 

(a) 0. 2’ 3’ ? ■ ■ ■ ’ 

,,, 2 3 4 n -1- 1 

2’?- 

1 1 1 

W ITS' * 


V2' ^2 ^2 ' a 72 

1 1 

- • • ■ , • 

'S/n 


, , 1 1 

“ r Vi' VI 


6. Existence of the Limit. The definition of convergence of a 
sequence {xi} given in Sec. 3 implies the existence of the limit L, 

* The factors a are bounded since a ^ 2 < 1. 
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since the application of the test, based on this definition, requires 
the knowledge of the limit L. 

The problem of the numerical calculation of the limit of any 
given sequence ordinarily :s an exceedingly difficult one, but in a 
great variety of practical and theoretical investigations one is 
satisfied with knowledge of the behavior of the sequence as 
to convergence and does not require the numerical value of the 
limit. There is a profound theorem due to A. Cauchy that 
enables one to establish the existence of the limit of a sequence 
without actually calculating the limit itself. This important 
theorem is as follows: 

The Fundamental Principle of Convergence. A necessary and 
sufficient condition for the existence of the limit of the sequence 
{xn] is that for any e > 0 one can find a positive integer N such 
that for any pair of indices m and n, both greater than or equal 
to N, 

\Xni - Xn\ < €. 

It will be established first that the condition enunciated in 
the principle is a necessary one. Let the sequence converge, and 
denote its limit by L. Then for any positive e, however small, 
one can find a positive integer N such that 

(5-1) \L - a;„| < I 

whenever n > But one can write 

Xm Xn — (Xm [ L) “f" (L Xn') 

and, noting that the absolute value of the sum is less than or at 
most equal to the sum of the absolute values, one has 

\Xm —Xn] \Xm — L| + |L — Xn 


where the last step results from the hypothesis (5-1). 

The demonstration of the sufficiency of the condition is not so 
easy. An analytical proof makes considerable demands on the 
mathematical equipment of the reader,* but the correctness of 

* See Hobson, E. W., Theory of Functions of a Real Variable, vol. 1, p. 38. 
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the converse of the principle can be seen from the following 
geometrical considerations, which in essence do not depart from 
a rigorous analytical proof. 

The hypothesis this time is that for any e > 0, 

(5-2) \x^ — Xn\ < €, 

whenever m and n both exceed or are equal to N, which, of 
course, depends on the magnitude of e. Choose € = 34, and 
denote the corresponding value oi N hy Ni) then if is any 
index greater than Nij 

\Xn - ^dJ < M 

for every n > pi. 

Geometrically this means that all points Xn of the sequence 
for which n > pi lie within the segment of length unity which has 
Xp^ as its midpoint (Fig. 2). 





k- 



k- 1 



/ 

— > 

Y--i 


r ^ t 

— — -I - ■■ 


— 1 

\ 



::~-1 



^Pl ^P3 

Fig. 2. 


If 6 is taken equal to 34? there will exist an integer pi > Pi, 
such that for every n > p 2 

\Xn — Xp^ < 

Then all points Xn, for n > will lie within that portion of the 
segment of length with Xp, as the midpoint, which is contained 
in the segment of length unity. Setting 6 = one is assured 
of the existence of an integer ps > such that 

IXn - Xp,\ < 

whenever n > p^. That is, the inequality is satisfied for all 
points Xn that are contained in that portion of the interval of 
length with Xp, as the midpoint, which is common to th 
interval of length 3^ with Xp^ as the midpoint, 



LIMITS AND CONTINUITY 


13 


Continuing this process by assigning to e successively the 
values ^7 etc., one builds up a sequence of intervals diminish- 
ing in length and such that the end points of these intervals tend 
to a definite point L, which is the limiting point of the sequence. 
Thus the existence of the limit L is demonstrated, provided the 
condition (5-2) is satisfied. 

The fundamental criterion of convergence is frequently 
stated in the following somewhat different, but equivalent, form, 
which the reader will have no difficulty in deducing. 

Theorem. A necessary and sufficient condition for the conver- 
gence of the sequence 

^ 1 } ^2, * * * j * ‘ ' 

is that for any € > 0, one can find a positive integer N such that 

^n\ € 

when n > Nj and for every positive integer k. 

It is seen from the foregoing that the significance of the criterion 
is, roughly, that all terms of the sequence for sufficiently large 
values of the indices lie arbitrarily near one another. 

In order to illustrate, the application of the fundamental 
criterion, consider the sequence 

Ij • j 

where each term is the arithmetic mean of the two terms which 
immediately precede it. Thus the general formula for the nth 
term of the sequence (n > 2) is 

— 1 “f” ^n—2 
2 

It is easily seen that the difference between two consecutive terms 
of the sequence is 

„ (-ly 

iCn-f-l Xn 2" ' 

But all the terms following Xn+i lie between Xn and and 
if any € > 0 has been assigned, one can choose a positive integer 
N so great that 
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With this choice of N the inequality 

X-n 

will surely be satisfied for any m and n that are not less than N. 
Thus, by the fundamental criterion, the sequence is convergent. 

As an exercise the reader may attempt to show by induction 
that 

= 1 JL 

3 * 

so that the limit of this sequence is although one need not 
know the limit itself in order to establish the convergence of the 
sequence. 

6. Criterion for Convergence of Monotone Sequences. The 

fundamental criterion of convergence is applicable to any type 

L M 

, 1 1 1 1 1 

Xj ^3 

Fig. 3. 

of sequence, but if one is dealing with monotone sequences (that 
is, such that either Xn+i > Xn for all values of n or .Tn+i < Xn 
for all values of n), there is a simpler criterion that states that 
a monotone sequence which is hounded is convergent. 

In order to make this assertion plausible, assume tlie sequence 
{rcn} to be monotone increasing and brunded, that is, 



and \xj{ < M for every value of n. Geometrically this moans 
that the points corresponding to the elements Xn of the sequence 
move to the right with increasing values of the index n (Fig. 3) 
but are always restricted to lie to the left of the point corrcispond- 
ing to the number M. It is thus intuitively clear that there must 
be some point L M toward which the points ir,,, tend with 
increasing n. This point L is the limit of the sequcmce. 

The discussion in the preceding paragraph applies to the case 
of monotone decreasing sequences bounded on the left if the 
words right and left are interchanged. It should be remarked 
that the foregoing discussion is based on an intuitive notion as 
to what happens in a corresponding geometrical situation. A 
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rigorous analytical proof based on a refinement of this pictorial 
idea is omitted. 

To illustrate the use of this criterion of convergence of mono- 
tone sequences, consider the sequence {xn}, where 


X2 = yi M? 
2:3 = M M 


Xn — 


+ 


?2r 1 7?. -]- 2 


+ 




This sequence is monotone increasing since 

Xn+l - 2n + 1 “ 2n + 2 ^ 

Moreover, it is bounded for 

Xn = -4 :t + ^-0 + • • • + ^ ^ < 1. 

n+1^ + 2 2n ti+I 

Therefore, the sequence [xn] is convergent. 

The power of this criterion lies in the fact that it requires only 
the proof of monotonicity and of the boundedness of the sequence. 
Accordingly, it is much easier to apply than the more general 
fundamental criterion. 


PROBLEMS 

1. Show that the sequence 




•, 1 + 2 + 4 + - • • 


is convergent. 

2. Prove the convergence of the following sequences: 
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7 . Divergent Sequences. Upper and Lower Limits. Consider 
again a variable x that assumes a set of real values 

Xij X%j * ‘ • • • 

and a set of points Pi, P2, * • • , Pn, • • • associated with it. 
If the sequence {xn} fails to converge, it is said to diverge. 

The sequence may fail to approach a limit because the variable 
X becomes infinite, which simply means that one can find a posi- 
tive integer N such that for every n > N 

\Xn\ > M, 

where ilf is a preassigned positive number, however large. In 
geometrical language, the statement that x becomes infinite 
means that no matter how large a segment with 0 as the midpoint 
one may take, there will be points Pn that lie outside this segment. 
If the variable x becomes infinite in such a way that after some 
value, say Xp, it remains positive, it is said to tend to positive 
infinity. On the other hand, if it becomes and remains negative 
after some Xp, it is said to become negatively infinite or to tend 
to negative infinity. 

For example, if x takes on the set of values 

— 1 , 2 , 3 , ■ ■ , Uj , 

it becomes negatively infinite. This behavior is commonly 
denoted by writing 

lim x,^ — — 00 

n— > 00 

but this notation is bad since in this case the limit docs not 
exist. It should be kept clearly in mind that the mark qo is 
not a number but a symbol representing the idea that the variable 
X increases without limit. 

The variable x may also change in such a way that it neither 
approaches a limit nor becomes infinite. For example, if x 
assumes a sequence of values 

1 , - 1 , 1 , - 1 , • • • , 
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it is clearly bounded, but instead of approaching a limit, it 
oscillates between +1 and —1. 

In defining the limit L of a sequence {xi}, it was stated that 
the inequality 

\L — Xn\ < e 

must be fulfilled for every value of n > p, regardless of how 
small the number e is chosen. A geometrical interpretation 
of this statement is that an infinite number of points Pi, cor- 
responding to the elements Xi of the sequence, lie in every interval 


^-2e — >] 

t 1 L_j 1 1 

<~~-2e — 

1 1 


“2 

-I 

6 

i 

/ 

1 

^ ^/2 


Fig. 4. 


of width 2e whose midpoint P corresponds to the limit L of the 
sequence. Accordingly, the point P may be called the point 
of condensation or the limiting point of the sequence 
Points of condensation may arise even if the sequence 
is not convergent. For example, the sequence 


(7-1) 


„ 3 4 5 6 

2’ 3' 4’ 5' 




n 


does not converge, but there are infinitely many elements of 
(7-1) in the vicinity of the points —1 and +1. Any interval of 
width 2e (Fig. 4) about x = —1 ora;== +1 contains infinitely 
many terms of the given sequence, so that the points —1 and +1 
are limiting points of the sequence (7-1). 

The points of condensation are of considerable importance 
in the study of the so-called power series.^ 

Definition of Limiting Point. A number L is called a limiting 
point of a sequence { Xt } if for any e > 0 there is an infinite number 
of terms of the sequence satisfying the inequality 

\Xn — L\ < e. 

The distinction between the definition of the limiting point 
and that of the limit is that, in the definition just given, the 
inequality 


» See Chap. VIII. 


\Xn — L] < € 
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must be satisfied for any infinite number of terms of the sequence, 
whereas in the definition of the limit the same inequality must be 
fulfilled for every Xn whose index n exceeds some fixed 'positive 
integer p. Any number that occurs an infinite number of times 
in a sequence is obviously a limiting point. Thus, the sequence 

(7-2) 1, K, 1, 1, K, . . . 

has 1 and 0 as its limiting points, but the limit of this sequence 
obviously does not exist. 

A fundamental theorem concerning bounded sequences, due 
to B. Bolzano and K. Weierstrass, is stated as follows: 

Every hounded sequence possesses at least one limiting point. 
Moreover, it can be established that every bounded sequence 
has a least limiting point and a greatest limiting point.* This 
latter assertion is certainly obvious if the number of limiting 
points of the sequence is finite. 

Definitions of Upper and Lower Limits. The least limiting 
point of a bounded sequence [xn] is called the lower limit and is 
denoted by the symbol 

lim Xn = I 

The greatest limiting point of a bounded sequence {a:„} is called 
the upper limit and is designated by the symbol 

lim Xn = L. 

Recalling the definition of the limiting point, it is clear that 
if I is the lower limit of the sequence then for any e > 0, 
there will be infinitely many terms of the sequence such that 

I “f” €, 

and at most a finite number of the XnS such that 


Xn <l — 

On the other hand, L is the upper limit of the sequence 
if there are infinitely many terms of the sequence such that 

Xn> L — e, 

* For a rigorous arithmetical proof of these assertions see E. W. Hobson, 
Theory of Functions of a Real Variable, Secs. 46-48. 
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and only a finite number (or none at all) such that 

Xn Z/ -f" €. 


It follows from these statements that —1 is the lower limit of 
the sequence (7-1), while +1 is its upper limit. The lower 
and upper limits of the sequence (7-2) are 0 and 1, respectively. 

It is customary to extend the definitions of the upper and 
lower limits to unbounded sequences by saying that if there are 
infinitely many terms of the sequence {Xi} whose magnitude 
exceeds any preassigned positive number M, then the upper limit 
L is -h oo ; on the other hand, if the sequence is such that 
there are infinitely many terms Xn satisfying the inequality, 

Xn < — ikf, 

where M is any arbitrarily large positive number, then the lower 
limit Z is — 00 . 

For example, the sequence 

(a) 1, 2, 3, • - 

has L = + 00 , whereas the sequence 

(&) -1, -2, ~3, • • • 

has Z = — 00 . The sequence 


•(c) 


-1, 2, -3, 4, -5, 6, • • 


has L = + 00 and Z = — oo . 

Some further examples of upper and lower limits of sequences 
may prove useful. The sequence 


id) 


“1, 


1 1 1 
2’ “r 1’ 


(-1)" . . . . 
n 


has L = 0 and Z = 0, but the sequence 


+1? +lj “Ij * * * 
has Z = — 1 and L == 1. The sequence 

1, 2, 4, • • • , • • • 

has Z = 0, L = 00 ^ whereas 

“1, -2, “4, • ■ • , 

has Z = “ 00 and L = 0 . 
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It wiU be obsemd that no definition of the lower ^ 
supplied for sequences of the type (a), whereas sequences o the 
Z (b) lack a definition of the upper limit. It is desirable to 
these gaps so that one can say that every sequence has 
uniquely ifined upper and lower limits. Accordingly, it is 
agrid that if the sequence {x;} is such that +« is its only 
limiting point, then the lower hmit I of such a sequence is also 
On th^ other hand, if — is the only limiting point of 
the sequence, then both the upper and lower limits are defined 

sequence (d) is interesting because it has L = 1 = 0 . 
There is a theorem in regard to bounded sequences whose upper 
and lower limits are equal. 

Theorem. A necessary and sufficient condition for the conver- 
gence of a hounded seance is that the upper limit L he equal to the 

lower limit 1 . 

The proof of the theorem is not difficult, f or, it 
L = l = A, 

then for any . > 0 there is at most a finite number of terms 
of {Xn} such that 

Xn>L-{'( = A-\-t, 

and also at most a finite number of x» for which 
„ ^ ^ ^ = A — 



Thus, 

A-e<Xn<A + t, if 
or 

la:„ - 11 < e, if n> p, 
which is the statement that lim x„ = 1 - 

n— )• 60 

Conversely, if 

lim Xn = 

n-A M 

then for any € > 0 and forn ^ p 

( 7 - 3 ) \xn-A\<e 
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or 


A. € <C X-n <1 A C. 


Therefore, 

(7-4) a:„ < A -I- € 

for an infinite number of x„, and the inequality 

Xii, A — € 

is true for at most a finite number of the Xn. Thus 
(7-5) 1 = A. 

But (7-3) also states that 


a:„ > A — e 

is true for an infinite number of Xn, and that there are at most a 
finite number of a;„ for which 

Xn > A + i- 


Consequently, 

(7-6) L = A. 

It follows from (7-5) and (7-6) that 

I = L. 
PROBLEMS 

1. Which of the following sequences diverge? 


(а) 0, 1, 0, 2, 0, 3, 0, 4, • • • ; 

(б) 1, H, K, • • • ; 

Ifi) 1 ) Mr ■ ■ ■ ; 

(d) M, H, H, Vi, ■ ■ ■ ; 


3 7 2"+i - 1 

2' 2^' ‘ ’ 2 


(/) log 1, log 2, • ■ • , log 
1 _ 1 _ 1 
log 2 ’ log 3’ ’ log n 

(h) log log , log . 


2 . Find the upper and lower limits for the sequences of Prob. 1, 
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8. Functions of a Single Variable. Let a pair of variables y 
and X be connected by some functional relation. The functional 
dependence of y upon x will be denoted by the symbol y = /(x), 
which means that to every value of x under consideration there 
corresponds at least one value of y. There is no implication in 
the foregoing statement that there is an analytical expression or a 
formula connecting y with x. In the study of elementary 
analysis one usually thinks of a function as being given by a 
formula indicating the result of performing some operations on x, 
such as \/l — x, log x, sin 2xj etc. In the definition given 
here the term function has a much broader meaning. 

It will be assumed that the variable x is a real variable and that 
the corresponding values of y are also real. The function 
y = f(x) is called a single-valued function if to every value of x 
under consideration there corresponds one and only one value of 
y. Otherwise, the function f{x) is called multiple valued. Thus 
y ^ x^ is a single-valued function, whereas y = sin”^ a; is a 
multiple-valued function of x. 

It is frequently necessary to restrict the range of values which 
X is permitted to assume. The function y \/x furnishes 
real values for 2 / only if x is restricted to be positive or zero. 
It is convenient to think of the values of x as being associated 
with the points of the a;-axis of a cartesian system of coordinates, 
so that one can speak of the interval consisting of all real numbers 
between a pair of given values (say, x — a and x = h). Such an 
interval is denoted by the symbol (a, 6), where a <b. If the end 
points of the interval (a, b) are excluded from consideration, the 
interval is said to be open, and the fact that x is not permitted to 
assume the values a and b is denoted by writing 

a < X <b. 

On the other hand, if the interval is closed, one writes 

a < X < b. 

The interval may be open at one end point and closed at the other. 
For example, 

a < X <b 

means that the interval is closed on the left, so that the point 
a: = a is included in the considerations, whereas x = his excluded. 
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If for all values of re in a given interval, f{x) is never greater 
than some fixed number M, the number M is called an upper 
hound for f{x) in that interval, whereas if f{x) is never less than 
some number m, the latter is called a lower bound. One or both 
of these bounds may not exist. Thus y = sin x in (0, 27r) has 

an upper bound +1 and a lower bound —1, whereas == “ m 

X 

the interval (0, 1) has a lower bound unity and no upper bound. 

The function y — x has neither upper nor lower bound in the 
X 

interval (0, co). 

In considering the functional dependence of y upon it may 
happen that as x approaches, by any conceivable sequence of 
steps, the limit xo, y also approaches a limit L, so that one can 
write 

(8-1) lim y = lim f{x) = L 

X-^Zo Z—>Z0 

The precise meaning of this symbolic expression (8-1) is embodied 
in the following definition of the limit of f(x) : 

The function J{x) approaches the limit L as x tends to xo when, 
corresponding to any given positive number €, one can find a number 
h such that \f{x) — L| < efor all values of xfor which 

0 < [a; — rco| < 5. 

It should be noted carefully that the statement 
0 < \x — Xo\ < d 

excludes the point x — Xo from consideration, so that the numer- 
ical value of the difference must be less than e for all points in 
the interval {xo — 5, xo + 5), except at the point x = xq. More- 
over, no restriction is imposed as to the way in which x is per- 
mitted to approach Xo, so that the inequality 

l/(^) -L\<e 

must be satisfied whenever x-^xo through a set of values greater 
than or less than xq. 

It may be remarked that, since 

(8-1) lim f(x) = L 

X — yxo 
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means |/(a;) — L\ < e for all values of * for which 
0 < |a: — Xol < S, 
one can write (8-1) in an alternative form 
(8-2) f(x) =L At n, 

where li?l < e for all values of x such that 0 < |a: — Xo] < 5. 
The particular form (8-2) of the definition (8-1) will be of fre- 
quent use in the following pages. 

It is sometimes important to know the behavior of /(») when 
a: — > 2 o in such a way that x always remains greater (or less) than 
Xo, that is, when x is allowed to approach xo from the right (or left) 
side only. In such cases it is convenient to adopt the following 
notation, li x-^Xq from the left (that is, x is always less than 
Ko), one writes 


X — > Xo—, 

and the fact that x-^xo from the right (so that x is always 
greater than Xo) is denoted by 


X — > Xo-f . 


These limits will be called the kft-hand and the right-hand 
limits, respectively. 

Also 

lim/(x) — a or /(xo— ) = a, 

x-^xo — 

and 

lim/(x) = 6 or f(xo+) = b, 
a;— >a;o4* 

will stand for the left-hand and right-hand limits of /(x). The 
symbols /(xo-b) and /(xo— ) should not be confused with the 
symbol /(xo), which means the value of the function /(x) calcu- 
lated at the point x = xo. In fact/(xo-l-) and /(xo— ) may exist, 
whereas the function f{x) may not be defined at x = Xo- To 

clarify this, consider an example. Let f(x) = 


It 
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is readily established that 

lini/(a;) s/(0-) = 0, 

2— >0 — 

and 

. lim/(x) =/(0+) = 1, 
while ^ 

m = 

1 - eo 

which is utterly devoid of sense 
since division by zero is undefined 
(Fig. 5). 

Since another example may prove useful, let f{x) = 2®“h 
In this case (see Fig. 6) /(!+) = <» , /(I— ) = 0, but /(I) = 2^ is 
meaningless. 


X 

Fig. 6. 

The function y = sin - has neither /(0+) nor /(O— ), since 
sin - oscillates between its upper and lower bounds +1 and —1 

X 

as a; 0 from either side (Fig. 6). 

PROBLEMS ^ 

1. Yind the right-hand and left-hand limits of fix) = 'x^ as 2. 

What is lim * 

a — >2 — 

pi/ X - 

2. Find/(0+) and/(0-) if /(a;) = ^hat is hm/(a:)? 

1 e‘^* i-»o 

3. What are/(0+) and/(0-) if /(«) = x sin -? Sketch the graph of 

X 

fix) in the vicinity of a; = 0. Find lim fix). 
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4. Fiiid/(2+) and/(2-), if /(a;) = — i — 

X — 2 

5. What is lim sin a;? sin | f+V sin V 

.-i / 

6. Find lim — —tt" 

®-*o 1 — 

Sketch the graph of the function in the neighborhood of a: = 0. 

9. Theorems on Limits. 

Theorem 1. The limit of a sum is equal to the sum of the limits. 
If lim fi{x) = Li and lim f^ix) = La, then 

X~^XQ x~^X0 

lim [fiix) + Mx)] = Li + La. 

X~^XQ 

The proof of this theorem follows directly from the delSnition 
of the limit. It is required to show that for any preassigned 
positive number « one can determine a number 8 such that 

|/i(a:) + fi(x) — Li — La| < e, 

whenever x lies in the interval 0 < |a: — a:o| < 5. But by 

hypothesis, lim /i(a:) = Li, so that ' 

x—^xo 


(9-1) |/i(a;) — Li| < whenever Q < |a; — a:o| < 5i. 

Similarly, 

(9-2) 1 / 2 ( 0 ;) — Lai < whenever 0 < |a; — a;o[ < 82 . 

Now if 8 is chosen to be the smaller of 81 and 82, then it foUows 
from (9-1) and (9-2) that* 

l/i(^)t/2(a;)-Li-La|.<i + | = e, 
whenever 0 < |a; - a;ol < 8 . 

* Since the sum of the absolute values is not less than the absolute value 
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But this is precisely the statement that 

lim [fi(x) +/ 2 (^)] == Li + L 2 * 

The extension to a greater number of functions follows immedi- 
ately. 

Theorem 2. The limit of a product is equal to the product of the 
limits. 

If limfiix) = Li and lim/ 2 (a;) = L 2 , then 

X — >x<i X — >a;o 

(9-3) liin/i(a:)/ 2 (a;) = L 1 L 2 . 

X~^Xq 

It is required to show that 

— LiLi\ < e, whenever 0 < [a; — a:o| < 5. 

But 

\fiix)Mx) - L1L2I = \fi{x)Mx) - L^,{x) + L 4 ,{x) - LM 
^ \fiix)Mx) - Lif2(x)\ -f- |Li/2(a;) - I/1Z/2I 
= \Mx)\ • \fiix) - Lil + |Lil • 1/2(0:) - L2I. 

By hypothesis lim fsix) = L 2 , so that f^ix) is surely bounded 

X—^XQ 

in the neighborhood of the point x = xq. Hence, \f 2 {x)\ < M 
for all values of x such that 0 < [a; — tro] < d\ Then 

l/i(^)/2(a^) - W < M • \h{x) Li| + |Lx| • I/ 2 W - U\. 

'Moreover, since lim /i(rc) = Li andlim/ 2 (:r) = L 2 , corresponding 

X — ^XO X — >XQ 

to any € > 0, one can find a positive number d < d' such that 

l/.W - i.l < 2^. 

and 

\Mx) - L2I < 

whenever 0 < jo: — a;ol < d. Thus 

|/i(a:)/ 2 (a:) - L1L2I \L,\ * ^ = e, 

whenever 0 < [rc — a;o| < 5, which is equivalent to (9-3). 
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The result can be immediately generalized to any number 


of functions. 

Theorem 3. The limit of a quotient is equal to the quotient of the 
limits, 'provided the limit of the denominator is not zero. 

If lim fi{z) = Li and lim f 2 {x) = 9 ^ 0 , then it must be 

x— »X0 X— >xo 

proved that 


lim 

X— >xo 


/l(^) ^ 


h 

U 


Note that 


/iW _ U 
Mx) Li 


fiix) _Li. 

Li Li\ 

f [/x(x) - Li] 

_Jb2 


/i(^) I M^) 

Li '^Mx) 


+ 


Mx) 

Lifi{x) 


[Li - Mx)] ■ 


But, since the hmits of /i(a:) and fi{x) exist and lim fi{x) 9 ^ 0, 

x-^-xo 

one can certainly make the numerical value of each bracketed 
term of the right-hand member of the last expression less than 

when 0 < |a; — xol < 5. Therefore, 


Mx) Li ^ 


when 


which is the required result. 


0 < lx — a;o| < 5, 


PROBLEMS 


1. Give a careful justification of the inequality 
/iW 


|/2(x) - U 


€ 


[Lif^ix) 

used in the proof of Theorem 3. 


when 


0 < |x — Xo| < 5, 


2. If n is a positive integer, prove that lim x” = 0, and, hence, that 

x->0 


lim (ao + aix + + - . . + a^x^) = ao. 

x->0 


10. The Base of the Natural Logarithms. An interesting 
application of the criterion for convergence of monotone 
sequences to the determination of the limiting value of the 


function 



as X— » 


00 , is contained in this section. 
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It will be shown first that - ) approaches a limit when 

X tends to infinity by assuming positive integral values. In 
this case the problem reduces to the study of the behavior of 
the sequence {xn}j the nth term of which is given by the formula 



It will be shown that the sequence {ajn} is monotone increasing, 
bounded, and hence convergent. 

Now the ratio of Xn to x^-i is 



But by the inequality of Bernoulli,* for any n > 1, 


Hence, 



so that the sequence {xn} is monotone increasing. Moreover 
it is bounded on the right, since 



and the sequence ( 1 + — ) is monotone decreasing.rf 


* See Sec. 4. 
t See Prob. 2, p. 31. 
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Therefore, 


and thus 


(■•S' 


< (1 + ly - 4 , 


converges to some limit, which will be denoted 
by the letter e. Hence, 

(10-1) lim (l -f = e. 

n — > M \ Tl/ 

Consider now the function 



where x is allowed to take on any sequence of positive real 
values tending to infinity. Let n be the greatest integer con- 
tained in any given value of x, so that 

n < X < n + 1. 

If X tends to infinity, the number n does likewise, and one can 
write 


But it follows from (10-1) and from Sec. 9 that 

j \ ™+i 


lim ( 1 -f 


1 


n + 1 


— lira 

n—* 00 


1 + 


n + 1 


= e. 


1 + 


n + 1 


Also 


lim(l+i)’"-lta.[(l+hYl + i 

n-)-oo \ n/ n-^oo L \ \ 


= e. 


Since the extreme members of the inequality (10-2) tend to 
the same limit, it follo-ws that 



( 10 - 3 ) 


= e. 
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The problem of computing a rational approximation to the’ 
number e with any desired degree of accuracy is discussed in 
Chap. IX. 

PROBLEMS 

1. Show, with the aid of the result (10-3), that 



Hint: Introduce the new variable ^ — (1 + a;) and let | tend to infinity 

through any set of positive values. 

2. Show that the sequence {yn}, the nth term of which is 



is monotone decreasing and bounded. Form the sequence {yn *“ Xn} 
where {a;„} is the sequence discussed in Sec. 10, and hence, deduce that 
lim 2/n = e. Show that 1 ^ e < 3. 

11. Continuity. In defining the limit of f{x) as x—^xo, no 
assumption was made regarding the value of the function at 
X = Xq. In fact, it was emphasized that the function need not 
be defined at :r = xq. 

The function f{x) is said to he continuous at the 'point x = Xq, 
if the right-hand and left-hand limits of f{x) as x Xq are equal 
and finite and coincide with the value of the function at x — x^. ^ 
This definition can be stated compactly in the form of an 
equation 

(11-1) lim /(a;) = f{xf). 

x—^xo 

A more explicit way of restating the definition of continuity 
(11-1) is the following: 

If for any preassigned positive number e, one can find a positive 
number b such that 

(11-2) |/(a;) — /(ico)! < e, whenever \x — a;ol < 5, 

then the function f{x) is continuous at the point x — Xq. 

A geometrical interpretation of the statement embodied in 
(11-2) is immediate. Corresponding to any preassigned positive 
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number there can be determined an interval of width 26 about the 
point X ^ Xq (Fig. 7) such that, for every x lying in the interval 
(:co — 5, xq + 6), f{x) is confined to lie between /(rco) + e and 


An alternative way of writing the defining equation (11-1) 
is frequently useful. Thus (11-1) can be written in the form 

(11-3) Kx) =/(a:o) + 17 , 

where lim 17 = 0. The identity of (11-1) and (11-3) follows 

X—^Xq 

immediately upon taking the limit of both members of (11-3). 



Two important remarks are in order: 


a. If the function is continuous, then lim f{x) must exist, 

b. The function must be defined at the point of continuity. 


The significance of these remarks is made clear by the following 
examples: 

Illustrative Example 1. To test the continuity of f{x) == x- at 
X = 2, note that /(2) = 4. Moreover, lim x- = 4. Hence, 

x ~^2 

f(x) = x^ is continuous at x = 2, 


Illustrative Example 2. 


Let/(x) = 


Now 


/(3) = 


32-9 

3-3 


0 

0 ' 


which is meaningless. But lim 1 = lim (a: + 3) = 6. 

Hence, if f{x) is defined to be equal to 6 at 5:: = 3, then f{x) will 
be continuous at x = 3, but not otherwise. 
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Illustrative Exam-ple 3. Let f(x) = ii x 0, and let 

sm CO 

f{x) = 1 if a; = 0. Now lim = 1, which coincides with the 

definition of f{x) at x = 0^ so that f{x) is continuous at x = 0. 

If it happens that the function f{x) is continuous at every 
point of the interval (a, 6), then the function is said to be con- 
tinuous over the interval (a, &). If the interval is closed, the 
continuity at the end points x = a and a; = 6 is defined by the 
equations 

lim /(a?) = /(a) and lim /(a;) = /(&), 
since such a symbol as 

lim j{x) 

has no meaning if the consideration of functional values is 
restricted to the closed interval (a, 2>). 

It is clear from the foregoing that any function that can be 
represented graphically as an unbroken curve is continuous. 
However, not every continuous function can be represented 
graphically. For example, let 

f{x) = X sin 

X 

and consider the behavior of the function in the vicinity of a; = 0. 
Inasmuch as sin - is defined at every point of the a;-axis, except 

X 

x = 0, one can calculate the values of f{x) for any sequence of 

values of x converging to zero. Moreover, since sin - is bounded, 

X 


lim a; sin - == 0. 


At the point a: = 0, f{x) is undefined, but if it is agreed to assign 
the value ^lero to /(O), the function 


fix) = X sin 

X 

= 0 , 


if a; 7 ^ 0, 

if a; = Oj 
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will be continuous at x = 0; yet the graph of the function in 
the vicinity of the origin cannot be drawn, since the function 
oscillates infinitely often in any interval containing the origin 
(Fig. 8). 

Whenever a function fails to be continuous at a point, it is 
called discontinuous at that point. The discontinuity 2 A x = Xq 
is called infinite whenever f{x) becomes infinite as a; — > Xq. If 
the function is discontinuous at a point x — xq but is bounded 



in the vicinity of that point, the discontinuity is called finite 
or ordinary. If fixQ+) and/(a;o— ) exist and are unequal, their 
difference 


is called the jump in the Junction, Thus the function 

Six) = — ?--j 
1 — e ^ 

discussed in Sec. 8 has a jump of one unit at x — 0, whereas 
1 

f(x) = 2^-"^ has an infinite discontinuity at x == 1, 

A function having a finite number of jumps in a given interval 
is called piece-wise continuous or sectionally continuous. 
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PROBLEM 

Discuss the continuity of the following functions: 


2a:; 


{a) y = : 

oh y = 

1 

(c) y = e*; 

{d) y = log x; 


(e) y = X sin 

X 

(f) y = sin 

X 


(?) y = 
(A) 2/ = 
{i) y = 


(1 - xy 


1 


1 - x'^’ 
1 


x^ 


3x + 2’ 


O') y = x + 

X 

(k) y = cot X] 


(1) y = 


cos X 


(m) y = 


X 

= 0, il X 
x^ - 1 


if a: 5^ 0, 


= 0 ; 

if a; 7^ 1, 
= 1 ; 


a; — 1 
= 2, if a; 

-l- 

{n)y = e if a; 0, 
= 0,ifa: = 0; 

(0) 2/ = 1 — a;, if a; > 0, 
= 1 + a;, if a; < 0, 
== 1, if a; = 0. 


12. Properties of Continuous Functions. It was seen from the 
discussion of f{x) = a; sin - in Sec. 11 that the intuitive idea of a 

X 

continuous function as a function that can be represented 
graphically as an unbroken curve is quite inadequate to account 
for functions that are continuous according to the definition 
given above and that may not be capable of graphical representa- 
tion in the neighborhood of a point of continuity. A function 
that can be represented graphically as an unbroken curve is, of 
course, continuous. 

The seemingly simple concept of continuity becomes, on careful 
examination, exceedingly complex. A detailed study of the 
properties of continuous functions is the province of the theory 
of functions of a real variable, but some of the simpler theorems 
follow directly from the definition of a continuous function and 
upon the application of the theorems on limits. 

Theorem 1. The sum, difference, 'product, and quotient of any 
finite number of functions, each of 'which is continuous at a given 
point X = Xo, will he continuous atx — Xq, provided that the denom- 
inator of the quotient does not vanish at x — x^. 

The proof of this theorem follows immediately from the 
definition of continuity with the aid of the theorems of Sec. 9. 
It is left as an exercise for the reader. 
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Theorem 2. If y = fi{x) is a continuous function at the point 
X = xa, and if z = fiiy) is a continuous furMion at y = yo, where 
yo = fiixo), then the composite function z = Mfiix)] is continuous 
at X = xo- 

By hypothesis z = f 2 (y) is continuous at y = yo, so that 
hm/2(2/) = f2.{yo). 

y-^yo 

Hence, corresponding to any e > 0, one can find a positive 
number 5i such that 

1 / 2 ( 2 /) -Myo)\ < «, when \y - j/o| < Si. 

But 

h{y) ^ Mfii^)], 

and, therefore, the foregoing inequality can be written as 
(12-1) |/ 2 [/i(a:)] -Myo)\ < «, when \fi{x) - yo\ < Si. 

But fi{x) is also continuous at x = xo', hence, corresponding to 
the positive number Si, one can find a positive number 5 such 
that 

I/i(a:) — 2/ol < Si, whenever \x — Xo\ < S. 

Thus (12-1) can be rewritten to read 

Ifilfii^)] -Myo)\ < €, whenever \x - a:ol < S, 

which is another way of sa 3 dng that 

Ivrafilfiix)] =/ 2 ( 2 /o). 

X—^XO 

The latter statement is precisely the definition of continuity. 

Theorem 3. If fix) is continuous at x = Xo andfixf) ^ 0, then 
one can find an interval about the point x = Xo such that fix) has 
the same sign as fixf) throughout this interval. 

The continuity of fix) at x = Xo means that corresponding to 
any e > 0 one can find a number 5 such that 

(12-2) |/(a:) — /(xo)l < «, when \x — a:oI < S. 

Now (12-2) can be written as 

(12-3) fixo) — e < fix) < fixo) -H €, when \x — a;o! < S, 
and if « is chosen to be equal to |/(a:o)l, the inequality (12-3) 
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reads 

(12-4) f{xo) - |/(a;o)l < fix) < /(xo) + \fixo)l 

when jo; — trol < ^o. 

Hence, if f{xo) > 0, (12-4) becomes 

0</(a:) <2fixo), 

so that fix) is positive for all values of x in the interval 
Xq — 5o <C 3 ; <! iCo “h ^0* 

On the other hand, if fixo) < 0, then the inequality (12-4) shows 
that fix) < 0 in the interval Xo — do < x < xo + do. 

The reader might be inclined to regard the theorems just 
established as obvious from graphical considerations, which 
they indeed are if one restricts oneself to those continuous func- 
tions which can be represented by unbroken curves. 

13, Uniform Continuity. In defining the continuity of a 
function at a point x = Xo, it was stated that, corresponding to 
an arbitrary positive number e, one can find a positive number d 
(depending on e) such that for all values of x in the interval of 
width 25, with xo as the midpoint of the interval, the numerical 
value of the difference fix) — fixo) will be less than €. 

It is important to observe that the magnitude of d depends on 
both the number € and the value of x under consideration. This 
can be made clear by considering the function /(x) whose graph is 
shown in Fig. 9. Let € be prescribed; then for all values of x 
in the interval of width 25i about x = Xi 

l/W - /(Xl)l < €, 
whereas in order to make 

jf(x) -/(X 2 )l < € 

one would require the values of x in the neighborhood of the 
point X — X 2 to lie in a much smaller interval of width 252. 
Now the remarkable fact about functions continuous in a closed 
interval (a, h) is that one can find a number 5 which is independent 
of the particular value of x under consideration and thus depends 
on € alone.* Or, to put it differently, if the interval (a, 6) is 

* The proof of this is omitted. See E. W. Hobson, Theory of Functions 
of a Real Variable, p. 290; fi. Goursat, Cours d'analyse mathematique, 
5th ed., vol. 1, p. 14; C. J. de la Valine Poussin, Cours d^analyse infinit^si- 
male, vol. 1, p. 58. 
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divided in any manner whatever into a finite number of sub- 
intervals of widths not exceeding 25, then for any two points 
in the same subinterval, the numerical value of the difference 
between the values of f{x) will be less than 2e. To signify the 
fact that a single number 5 will serve for all values of x in the 
interval (a, 5), one says that the function is uniformly continuous 
in the interval. 

It is not difficult to see that a function which is continuous 
in the open interval (a, h) need not be uniformly continuous. 



Thus, the function f{x) = i is continuous in the open interval 

X 

(0, 1), but it is not uniformly continuous there. The difficulty 

here arises because - becomes infinite as a; 0. For any nonzero 

value of X the function is continuous, but it is impossible to 
subdivide the interval (0, 1) into a finite number of subintervals 
such that the numerical value of the difference of the functional 
values, for any pair of points in each of the partial intervals, is 
less than a preassigned number e. 

The property of uniform continuity of functions defined over a 
closed interval is used in the following theorems.* 

* The proofs of Theorems 1 and 2 will be found in E. W. Hobson, Theory 
of Functions of a Real Variable, pp. 281-285; 111. Goursat, Cours d'analyse 
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Theorem 1. A function f{x) continuous in a closed interval 
(a, b) is hounded in that interval. 

The theorem states that one can find a positive number M 
such that |/(a;) 1 < ilf , for all values of x in the interval a < x S b. 

Theorem 2. If f{x) is continuous in a closed interval (a^ b), then 
there exists in this interval at least one value of x for which f(x) takes 
its maximum value and at least one value of x for which it assumes 
its minimum value. 

Theorem 3. If f{x) is continuous in a closed interval (a, b) then, 
as X takes all values between a and b, the function f(x) takes at 
least once all values intermediate to f (a) and f(b). 

Corollary. If f {a) andf(b) are of opposite signs then there exists 
at least one point intermediate to a and b such that fix) vanishes at 
that poin\. 

In order to give an idea of the type of reasoning employed 
in proving these theorems, the proof of Theorem 3 follows. The 
corollary to Theorem 3 will be established first. 

Let the signs of /(a) and/(6) be opposite and set } 4 .iP' + b) == xi. 
If fixf) vanishes, the corollary is demonstrated. If fixi) 9^ 0, let 
(ai, bi) be that one of the two equal intervals (a, xi) and (xi, b) 
for which /(ui) and fQ>i) are of opposite signs. Form 

X2 = + bi). 

If fi^D = 0, the corollary is established. If fix2) 7^ 0, let 
(a2, 62) be that one of the two equal intervals (ui, xf) and (0:2, 61) 
for which /(a2) and fifof) are of opposite signs. If in continuing 
this process one does not obtain a number Xi such that/(a;i) = 0, 
there results a sequence of intervals 

(u, b), (Ui, 61 ), (<3-2, 62 ); * * ' ? bn)j * • • , 

such that each of them is contained in the preceding, and such 
that the function fix) has opposite signs at the end points of 
these intervals. 

The numbers a, ai, a2, • • • , • • • form a monotone- 

increasing sequence and remain less than b, so that they tend to 
some limit* c contained between a and b. The numbers 6, 61, 
?>2, • ’ * , fen, • * • ; on the other hand, are always greater than a 

mathematique, 5th ed., vol. 1, p. 16 (the English translation of this book 
contains these proofs on p. 143). 

* See Sec. 6 . 
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and form a decreasing sequence, so that they also converge to 
some limit c'. The limits c and c' are equal since the difference 

bn ~ Cln = ^(b — a) 

tends to zero when n increases indefinitely. 

But f(x) is continuous in the interval (a, h), and therefore the 
difference 


f{bn) - fifln) 

approaches zero when «. Moreover, since the signs of 
/(6„) and /(a„) are opposite, 

lim |/(6„) -/(a„)| = 2|/(c)l = 0. 


or 


m = 0 . 

Thus the corollary to Theorem 3 is demonstrated. 

In order to establish the theorem itself, let h be some number 
between /(a) and /(5) and form the function 

p{x) = - h 

The function F{z) is continuous in the interval (a, h) and has 
opposite signs at the end points of the interval so that there 
exists at least one value c intermediate to a and b such that 
F{c) = 0. But, if F{c) = 0, 

/(c) = fc, 

and the theorem is demonstrated. 

It may be remarked that if f{x) is steadily increasing or decreas- 
ing and is continuous in the closed interval (d, b), then there will 
be exactly one value of x, intermediate to a and b, for which /(x) 
assumes a prescribed value 1, intermediate to /(a) and/(6). 



CHAPTER II 

DERIVATIVES AND DIFFERENTIALS 
14. Derivatives.* 

Definition. If x = xo is any point of the interval {a, b) and if 
f(x) is a function of x defined over (a, h), then 

^ f{xa + h) -fjxg) 
h-^o h 

is called the derivative of f{x) at the point x = xo. 

Denoting the derivative of fix) &ix = xo by the symbol /'(lo) 
and recalling the definition of the limitf give 

( 14 - 1 ) + + 

where 

lim r; = 0. 

h —^0 

Rewriting (14-1) gives 

f{X(i + h) - fixo) = hf ixo) + h; 

hence, 

|/(a:o + h) -fixo)\ < \hf'ixo)\ + M. 

Now if any « > 0 is prescribed, 

\hf'{xo)\ + M 

can be made less than e by making h sufficiently small. Then, 
for any value of a; in the interval xo — h < x < Xa -{■ h, 

|/(a;) - /(a;o)l < €, 

* The reader is assumed to be familiar with calculations involving the use 
of the formulas for the differentiation of the so-called elementary functions. 
It is advisable to review them before proceeding with the study of this 
chapter, 
t See p. 24. 
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which states that f{x) is necessarily continuous at x = if it 
possesses the derivative at a; = xq. This result can be stated as a 
theorem : 

Theorem. Any function having the derivative at a point is 
necessarily continuous at that point. 

The converse of the theorem is not true, as can be seen from 
the following example (Fig. 10) : let 

f{x) = —X + 1, when a; > 0, 

f{x) = X + when a; < 0. 

The function is obviously continuous at a: = 0, but the derivative 
at a; = 0 does not exist since the limit of the difference quotient 

fix + A) - f{x) 
h 

independent of the mode of approach of h to zero, does not exist. 
This becomes clear immediately if one recalls the geometrical 



Fig. 10. — Graph of tho function 
y ~ —X + 1, if a; > 0; 

— a; + 1, if a; < 0. 


interpretation of the derivative as the slope of the tangent line 
to the locus of /(x). If the point x = 0 is approached from the 
right, the slope of the tangent line is —1, whereas it is equal to 
+ 1 when X — > 0 from the left. 

As a more interesting example consider the function 

/(x) == X sin -j if X 9 ^ 0, 

X 

= 0, if X = 0, 

which was shown* to be continuous at x = 0. However, the 
difference quotient is 
* See p. 33. 
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Ko + h) --m 

h 


A sin Y 0 
h 

h 


. 1 
sm Y? 
h 


and lim sin - does not exist, since sin y oscillates between +1 and 
h^o h h 

— 1 as A 0. 

To be sure, this function has a derivative at every point except 
X = 0, but it is possible to construct functions that are continuous 
for all values of x in a given interval, but that do not have a 
derivative at a single point of the interval.* Functions that have 
derivatives are called differentiable functions. 


PROBLEMS 

1. Show from the definition that f(l) = if /(x) = \/x* 

2. Does the derivative of 


= ITed- T)’ ^ 
= 0, if 

exist at X = 1? 

3. Let 

/(x) = x^ sin -? if 

X 

= 0, if 

Then 


1, 

X = 1, 


X 0, 

X = 0. 


h -^0 ^ h -^0 n 


For any point other than x = 0 a formula for the differentiation of the 
product can be used Thus, 


/'W 


0*1 1 

2 X sm cos 

X X 


which is meaningless at x = 0. Why? 

16. Differentials. If the functional relation between y and x 
is given in the form 


y = /(a:), 

* K. Weierstrass was the first to demonstrate the existence of such func- 
tions in 1861. Many examples of such functions have been constructed 
since then. 
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the variables y and x are called, respectively, dependent and inde- 
pendent variables. 

Let Ax be an arbitrary increment in x. The resulting change 
in the dependent variable y when x changes by an amount Ax 
will be written as Ay. The increment of the independent variable 
x will be named the differential of x and denoted by either Ax or 
dx. The differential of the dependent variable y, on the other 
hand, is defined by the formula 


(15-1) 


dy = f{x) dx, 


so that the differential dy and the increment Ay of the dependent 
variable, in general, are quite distinct. From the defining equa- 
tion (15-1) of the differential, it is clear that the derivative of 
y — /(x) can be expressed as the quotient of two differentials, 
namely. 



In this expression dx is assigned at pleasure, but dy is determined 
from (15-1). 

From the definition of the derivative 


it is seen that 


where 


fix) = lim 


Ay 

Aa: 


— fi^) + ‘>1) 


lim = 0. 

Ax—^0 

Solving for Ay gives 

Ay = f(x) Ax + 7j Ax 


and, since Ax = dx, 


Ay — dy = 7] Ax. 


For small values of Ax this difference is small. Geometrically 
77 Ax represents the portion of the increment Ay cut off by the 
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tangent line to the locus of j{x) at the point where the derivative 
is computed (see Fig. 11). 

Example. Let y = Then dy = 2x dx, while 

Ay = (x + Ax)^ — x^ = 2x Ax + (Axy. 

In this case t] Ax = {Axy, so that tj — Ax. 

PROBLEMS 

1. Find dy and Ay, y = x^. 

2. Find dy and Ay, if y = \/x + 1, a; > 0. 

3. Find dy and Ay, y = sin x. 

16. Derivatives of Composite Functions. If ^ = f(y) and 
y = (fix), one can eliminate y between these relations and obtain 

2 = flcpix)] = F{x). 

dz 

The function z — F(x) may have a derivative but often it is 
undesirable to perform the elimination of y in order to calculate 



If the functions f^y) and <p{x) are differentiable, it is possible 
dz 

to calculate ^ without performing the elimination. 

Note that if x is given an increment Ax, then y will acquire an 
increment Ay, and Ay when Ax — > 0, since cp{x) is assumed to 

be a differentiable and, therefore, continuous function. But 
corresponding to an increment Ay there will be an increment Az. 
Thus one can write 


( 16 - 1 ) 


Az Az Ay 
Ax Ay Ax 
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T Lz T Az i\y 

lim - — = lini - — * lim ~ — ■> 
Ax A^-^nA?/ A^_nAx 


or 


dz __ dz dy 
dx dy dx 

In writing (16-1) it is tacitly assumed that Ay 9 ^ 0/’ There 
remains to be considered the case when Ay — 0 for some choice 
of the values of Ax approaching zero. Now 


Az = f{y + Ly) - f{y), 
and if Ay — 0, then Az = 0, so that 


dz Az 

T- — lim — = 0. 
dx jf^x — ^'O Ax 


Moreover, if At/ = 0 then 


Hence, the formula 

(16-2) 


!( _ Ii„ ^ _ 0. 

dx A'r . — ^■O Ax 


dz _ dz ^ dy 
dx dy dx 


is true in this case also. 

As an illustration of this case, consider the function 


and 

Then 

and, for x = 0, 


z = 

u — x^ sin if X 9 ^ 0, 

= 0, if a; = 0. 

Az = 2u Au + (Auy 


Au = (Ax) 2 sin - — 
Ax 
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If Ax is made to assume the sequence of values 

1 -L JL 

T 2t nw 

then Au = 0, and hence 


Moreover, 



= 0 . 



- 



and the formula (16-2) is valid. 

17. Derivatives and Differentials of Higher Orders. Inas- 
much as the derivative of y — f{x) is a function of x, it may be 
possible to differentiate again to produce a new function, which is 
called the second derivative of /(x). The customary notations for 

the second derivative are f'{x) and The third derivative, 

that is, the derivative of the second derivative, is denoted by 

f^\x) or ^7 and so on. 
dx^ 

d^y 

The reason for the notation will be seen from the definition 

dx'^ 

of the differentials of higher order. The differential of y = /(x), 

dy = f{x) dx, 

is a function of x and dx^ where dx is entirely arbitrary. Calculat- 
ing the differential of f{x) and treating dx as a constant give the 
second differential 


= d[f(x)] dx = f\x) {dxY, 

Similarly, 

rix) {dxy, 

and so forth. 

The formula for the differential of the nth order is 
(17-1) d^y = , 
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so that one can write as the quotient of two finite quan- 
tities, namely, 


This notation, however, is bad. For consider a composite func- 
tion z = f{y) where y = ip{x). From Sec. 16 it follows that 

dz = f{y) dy 

when 2/ is a dependent variable. But calculating the differentials 
of higher order by the formula for the differential of the product 
gives 

(17-2) dh = d[f{y) dy] = f(y) d(dy) + dy d[f{y)] 
f{y) d’^y +f'{y) {dyY 

which differs from the formula (17-1). 

If y is regarded as an independent variable, then dy must be 
considered as constant so that d^y = 0 and (17-2) agrees with 
(17-1), but the two results are quite distinct if y is not an inde- 
pendent variable. This is one of the reasons why the differentials 
of higher orders are seldom used.* 

PROBLEM 

Let y = /i(0 and x = /2(0 be such that the functional dependence of 
y upon X is given in a parametric form. It is known that 

^ ^ 

dx f^it) 

Now 

dx"^ dx \ dxj 

Applying the rule for the differentiation of quotients gives 

ON d'^x • dy 

dx^ {dxY 

On the ether hand, using formula (17-1), 

dy^f[{t)dt, f^t) {di)\ 

dx = f^{t) dt, ■■ fz lt) 

^ See also the problem on p. 48. 
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Substitute these expressions in the right-hand member of (17-3) and 
compare it witli the expression for ^ obtained in the usual way. 

18. Fermat’s Theorem. The reader is doubtless familiar with 
some geometrical considerations that lead one to suspect that a 
differentiable function f{x) has a vanishing derivative at the 
points where f{x) attains its maximum or minimum values. In 
fact, these geometrical considerations form a basis for the discus- 



sion of the maxima and minima in the first course in calculus. 
An analytical proof of the theorem due to Fermat gives a rigorous 
justification for such considerations. 

Theorem. If a function f(x) assumes a maximum or a minimum 
value at an interior point ^ of the interval (a, h), and if fix) is dif- 
ferentiable at X thenfii) = 0. 

Let it be supposed that at the point x — ^ the function attains 
its maximum value. (The proof for the case of a minimum is 
entirely analogous and is obtained by reversing the signs of 
inequality.) Remembering that a: = ^ is an interior point of the 
interval and that/(Q is a maximum, one has/(^ + h) — f(^) < 0 
for positive or negative h. Form the difference quotient 

(18-1) 


Since the numerator of (18-1) is negative or zero, 

fu + h) -m 


(18-2) 

(18-3) 


h 

M + ^) -m 


< 0 , 


^ 0 


for A > 0, 

for A < 0. 
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Taking the limit of (18-2) as 0 from the right, there results 

f (^) ^ 0, 

while the limit of (18-3) as 0 from the left is 

/'(?) ^ 0. 

But by hypothesis the derivative exists at x = so that the left- 
hand and right-hand limits must be equal, which is possible only 

iff (?) = 0. . 

19. Rolle’s Theorem. 

Theorem. J/ a function f{x) is continuous in the interval 
a < X ^ h and has a derivative at every interior point of (a, 6), and 
if the values of the function are equal at the end points of the interval, 
then there exists at least one point x = (a < ^ < 6), such that 

f (?) =0. 

Since /(x) is continuous in the closed interval (a, 6), it attains 
its maximum value M and its minimum value m in (a, h) 
(Theorem 2, Sec. 13). If it happens that m = ilf, then it follows 
that 

/(x) = const. == m. 

But the derivative of the constant is zero so that the theorem is 
true in this case. 



Next, assume that m < M. By hypothesis /(a) == f{b) so that 
at least one of the values m or ikf is different from the value of the 
function at the end points. Let it be M. Then the maximum 
value M is attained, not at the end points of (a, b), but at some 
interior point and it follows from Fermat's theorem that 
/(?) = 0 . 

It is important to observe that if the condition of the existence 
of the derivative is not fulfilled at a single interior point of (a, 6), 
the theorem may not be valid. This can be seen from Fig. 13. 
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In neither of the examples in Fig. 13 does the derivative exist at 

X = 0. 

If /(a) = f{b) = 0, Rollers theorem can be stated as follows: 
If a and b are two roots of the equation f(x) = 0, then f{x) = 0 
has at least one root between a and b, provided thatf{x) is continuous 
in the interval a S, x < b and has a derivative at every interior point 
of (a, h). 

20. Mean-value Theorem. 

Theorem. If a function f{x) is continuous in the interval 
a X b and possesses a derivative at every interior point of (a, 6), 
then there exists a point k such that 

(20-1) i: = /' 

If /(a) = f(b), the theorem is a special case of Rollers theorem. 
Assume /(2) ^ /(6), and construct a function 

F{x) == fci + fix) 

where the constant k will be so determined that Fix) satisfies the 
conditions of Rollers theorem, namely, 

Fia) - Fib), 
or 

ka + fia) = kb + 

Solving for k gives 


b — a 


With this choice of k, the function Fix) satisfies the conditions of 
Rollers theorem. Hence, there exists a point x — ^ such that 

= 0 . 


Then 


fU) - 


/(&) - fia) 
— — , 


and the theorem is established. 

A geometrical interpretation of this theorem is interesting. 
The expression 
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b — a 

is equal to the slope of the secant line joining the points A and B 

on the locus of /(cc) (Fig. 14). . , „ 

The mean-value theorem asserts that there exists a pomt P 
on the locus of f{x) such that the tangent line at this point is 

parallel to the secant line AB. 

The mean-value theorem 
(20-1) can be written as 

(20-2) 

which gives the magnitude of 
the increment fib) — f(a). 
For this reason the form (20-2) 
of the mean-value theorem is 
frequently called the formula of finite increments. 

Noting that k is an interior point of (o, b) and setting 

I = where 0 < 0 < 1, 

b — a 



one can write 

■ ^ = a -{- 6(f) — a). 

Substituting this expression for | in (20-2) gives 
(20-3) fib) - fia) = (b - a)f[a 0(6 - a)]. 

If the length of the interval (o, 6) is denoted by h, 

b = a A- h 

so that the expression (20-3) can be written in the following useful 
form; 

(20-4) fia + h) - fia) = hf'ia + dh), 

where 0 < 0 < 1. 

An important theorem follows immediately from the mean- 
value theorem. 

Theorem. If a function has a derivative that vanishes for all 
values of x in the interval a < x < b, the function is a constant. 
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Moreover, if two functions have derivatives that are equal for all 
values of x in (a, b) , then the functions differ by a constant. 

Let X be any point of the interval {a, b), and assume that 
f{x) = 0 in {a, b). It follows from (20-2) that 

Hence, 


which is constant. 

If fi{x) and f 2 {x) are two functions with equal derivatives in 
(a, b), then 


has a zero derivative in (a, b). Therefore, 

F{x) = const., 

and 

/i(^) = Mx) + const. 

21. Theorem of Cauchy. L’Hospital’s Rule. 

Theorem. If f(x) and (p{x) are continuous in the interval 
a ^ x < b and have derivatives at each interior point of {a, b), 
then 

m .. 

<PQ>) - ^(a) 

provided that 

i. fix) and <p\x) do not vanish simultaneously in (a, b); 

ii. (pQ)) ^ <pia). 

Note that the function 

Fix) ^fix)yib) - ^(a)] - pix)[fib) ~/(a)j 

satisfies the conditions of Rollers theorem, since Fia) = Fib), 
Hence, 

(21-1) fmm - <pm - <p'mQ>) - m\ = o, 

where (a < ? < b). 

Since fix) and <p'ix) cannot vanish for the same value of x, and 
since ^(b) cpia), it follov/s that <^'(|) cannot vanish, Cousc- 



ADVANCED CALCULUS 


54 


§21 


quently, one can divide (21-1) by — <p{a)] to obtain 

the desired formula 


(21-2) 


<p(jb) - 


ia<^< 


If (p'(x) is assumed to be different from zero at every interior 
point of the interval (a, h), then the conditions (i) and (ii) of the 
theorem are satisfied automatically. The condition (i) is obvi- 
ously satisfied since <p^{x) 7^ 0, and the fact that ^(5) ~ ^(a) 7^ 0 
follows directly from the mean-value theorem. 

It is interesting to observe that (21-2) contains, as a special 
case, the mean-value theorem, for, setting ip{x) = x gives 


/(&)"-/(a)=/(l)(6-a). 


It is readily shown that (21-2) can be written in the form 


/(ct h) — f(a) _ f{a 4~ ^h) 
<p{a h) — <p{a) <p'{a + dh)' 


iQ<e < 1 ). 


An important use of formula (21-2) is in the evaluation of inde- 
terminate forms. Thus, if /(a) = <p{a) = 0, and if the theorem 
be applied to the interval (a, x), there results 


(a < ^ < x). 


From this equation the following rule is obtained: 


Rule. If /(a) = <p{a) = 0, and if the ratio 

fix) 


fix) 

fix) 


approaches a 


limit asx—^a, then approaches the same limit. This rule for 


evaluating indeterminate : 
illustration consider the ca 


as is dtlq to L^Hospital. By way of 
of 


lim 


- COS X 

x 


Now (1 — cos x)x^o = {x^)x=Q = 0, and one can apply the rule of 
L^Hospital provided that 


V sm a; 


ejdsts. But this again is an indeterminate form since 
(sin x)^o = i2x):c^o = 0. 
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But 


exists since 


Hence, 


lim 


lim 


cos X 


X- 


cos X 1 
2 


The rule of L’Hospital can also be applied to indeterminate 
00 

forms of the type — The proof is direct. Let lim f(x) = « 

^ z~^a 

and lim tp{x) = «> , and assume that fix) and p{x) have non- 


vanishing derivatives in the interval a < x <X(,. 

Applsdng the formula of Cauchy to the interval {x, xo) gives 


<p(x) - 


{x 


: Xo). 


But 


fix) -/ (xo) _ 

. . ipjxp) 

pix) 

Thus 


(21-3) 


Assume that 


.m. 

Xo) 

f(^) 


This means that one can choose xo so near a that for all values of 
X between a and xo 


-L\<e. 
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Having chosen xq to satisfy this inequality, let x-^ a; then the 
first factor in the right-hand member of (21-3) can be made as 
near unity as desired. Hence, the left-hand member of (21-3) can 
be made to differ from L by as little as desired. This is another 
way of saying that 


lim L. 


The foregoing proof is easily modified to apply when a 
Example 1. 


1 


lim x\og X = lim = lim = 0. 

- • i x-^0+ 1 

X x^ 

Example 2. Evaluate lim ^ ^ 


Applying the rule of L'Hospital gives 


a: — sin a: 1 — cos x 

; 

a * — y 00 X X — > 60 

which does not approach a limit since cos x oscillates as x ■ 
But 

1 lim limfl-™ =1 

X 

since 

sin X . 

0, as 00 , 

X ’ 


iNote that this does not constitute a contradiction since the 
thii^orem asserts that if the quotient of the derivatives approaches a 
Ihnitj then the quotient of the functions has the same limit 


PROBLEMS 

1. Show that 

(a) lim 0, if n > 0; 

(h) lim 
0 


= 0, if n > 1; 
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(c) lim x^e-” = 0, if w > 0; 

X — >■ 00 

(^) =1. Hiut: Evaluate lim log aj®* 

(e) 

X- / 3 

2. Find 

(a) lim log x; 

X — > 00 

(b) lim x^e-«; 

, . sin X 

(c) lim 

x^C 

(d) lim ^ 

3 X — sm X 

(e) lim ( - — cot rrY 

x ->0 / 

3. Show that 

. . f tan X 

(a) hm I I = ve; 

x-^0\ X / 

(5) lim (tan — i 
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CHAPTER III 

FUNCTIONS OF .SEVERAL VARIABLES 

22. Limits and Continuity. Let u = f{x, y) be a real, single- 
valued function of two independent variables z and y. One 
can think of the pair of values x = Xa and y = yo as representing 
a point in the a^y-plane, so that u = f(x, y) at {xa, yo) becomes a 
function of the point. 

The function f{x, y) may be determined for every point of 
the a:y-plane, or the totality of admissible points may occupy 
a certain region R in the a:y-plane. Thus, if the attention is 
confined to real values only, the function 


u = y\. — x‘- — y 

is defined for those values of x and y for which 

< 1 . 

The region B in this case is a circle of radius unity whose center 
is at the origin of the xjz-plane. If the totality of points making 
up the region R includes the boundary of the region, then R 
is said to be closed. The function 

u = 

is defined in the open region + y^ < 1. 

The definition of continuity of a function of two independent 
variables is a generalization of the definition of continuity of a 
function of a single variable. Let f{x, y) be defined at the point 
(xij, yo) and in a sufficiently small region about this point. If 

(22-1) 


the function /(a:, y) is said to be continuous at the point {xo, yo). 
The precise arithmetical meaning of the statement embodied in 
(22-1) is the following: 


.58 
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If for any 'preassigned positive number e one can find a positive 
number S such that 

y) 2/o)| < €, 

'whenever \x — a:ol < S and \y — j/o] < 5, then the function is 
continuous, 

GeometricaHy this means (Pig. 15) that one can find a square 
about the point 2/0) so small that the difference between the 
values of the function at (rro, 
and at any other point (rr, y) 
within the square will be in 
absolute value less than any 
preassigned number €. 

Inasmuch as nothing is said 
in the definition (22-1) about 
the manner in which and 

y ^ 2/07 the limit must exist for 
any mode of approach to 
(a:o, 2/0). 

A function that is continuous 
at every point of a region R is said to be continuous in the region 
R. If the region is closed, the function is continuous in the 
closed .region. For example, u = — x^ — is continuous 

within and upon the boundary of the region bounded by the circle 
x^ + y^ = 1 . 

Only real functions of real variables x and y are considered 
in this chapter. There are theorems regarding such functions 
that are entirely analogous to those given in Chap. I for functions 
of a single variable. The more important of these are the 
following:* 

Theorem 1. If fix, y) is continuous at {xo, yf) andfixo, yo) 9 ^ 0, 
then one can find a region about the point {x^, yf) such that fix, y) 
has the same sign as fixo, yo) throughout the region. 

Theorem 2. A function fix, y) that is continuous in a closed 
region is hounded in that region. 

Theorem 3. If fix, y) is continuous in a closed region, then 
there exists in this region at least one point ix, y) at which fix, y) 

* The reasoning used in establishing the validity of these theorems is of 
the same character as that employed in proving the corresponding theorems 
for functions of a single variable. 
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takes its maximum value and at least one point where it assumes its 
minimum value. 

Theorem 4. If u and v are continuous functions of x and y, and 
if z is a continuous function of u and v, then z is a continuous 
function of x and y. 

The definition of uniform continuity of a function of two 
variables is as follows: 

If for any preassigned positive number e, one can find a positive 
number 8, the same for the entire region R, such that 

Ifi^h yi) -f{^h 2/2)1 < e, 

/or every pair of valves (xi, yf) and {x^, yf) that satisfy the inequali- 
ties \xi - real < 5 and \yi - y^l < S, then fix, y) is uniformly 
continuous in R. 

A function of two variables that is continuous in a closed 
region R can be shown to be uniformly continuous in R. 

The extension of these definitions to functions of more than 
two variables is immediately obvious. If 

« = /(^, y, z), 

the triplets of values (x, y, z) can be associated with the points 
of three-dimensional space. The square region \x - a:o| < 5 and 
12/ ~ 2 / 0 1 < h used in the definition of continuity of fix, y) must 
be replaced by a cubical region defined by the inequalities 

\x - Xf\ < d, \y - yol <8, \z - Zol < 8. 

If the function u depends on more than three independent 
\ ariables, the usual geometrical interpretation of the independent 
variables as the coordinates of points in ordinary space fails, 
but the geometrical language may still be used. Thus 
'a = /(aJi, Xi, xz, Xi), where Xi, Xz, Xz, and Xi are four independent 
variables, may be thought of as defined over a four-dimensional 
manifold, and the quadruplets of numbers (xi, Xz, Xz, xf) may be 
associated with the points of a hyperspace. 

A continuous function u = fix, y) of two independent variables 
a; and is a continuous function of each of the variables taken 
separately. Thus, if the value of one of the variables is fixed 
by setting y = y^, the resulting function of the single variable x, 
namely, 

w = /(a:, 2/o), 
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is obviously continuous in x. The converse of this statement 
. may not be true, however. For example, let 

y ) = ■■ unless X = 0 and y = 0 simultaneously, 

= 0, if X = 0 and y = Q. 

Then for any fixed value of y (or x) the resulting function of a 
single variable is easily shown to be continuous. However, 
f{x, y) is not a continuous function of the two variables x and y 
at X == 0 and y — 0. To show this, it will suffice to demonstrate 
that there exists one mode of approach toward the origin for 
which lim /(x, y) 0. Let the point {x, y) approach (0, 0) 
along the line y = x. Then 

Um 

ic— >0 ' 

3/— >0 

whereas /(x, y) is defined to be zero at the origin. 

A word of caution is in order in regard to the meaning of the 
symbols : 

(a) ]im f(x,y), 

lim lim /(x, y)^ 

and 

(c) lim lim f{Xj y). 

The limits in (6) and (c) are called the repeated or iterated limits, 
and the order of the two separate limiting processes in (&) and (c) 
cannot be interchanged in general. Thus, consider 



Then 


Em (lim 

^ - y . 


Em (lim I = 1. 

a— >0 xj/— +0 ^ y . 


while 
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The limit in (a), on the other hand, must exist for any con- 
ceivable mode of approach of (a;, y) to (xo, 2/0) • Hence, if the 
limit in (a) exists, the corresponding limits in (6) and (c) will 
exist and will be equal if the inner limits exist. The converse, 
however, is not true. The repeated limits (6) and (c) may exist 
and be equal, and yet the limit in (a) may fail to exist.* 

PROBLEM 

Show that f{x^ y) = . : is a continuous function in each 

*4“ {x 

of the variables taken separately but is not a continuous function of both 
variables at (0, 0). 

23. Partial Derivatives. Let u = f(x, y) be a single-valued 
function of the independent variables x and y, and let it be defined 
at some point {xo, yo) and for all values of {x, y) in some regionf 
U about the point (a;o, 2/0). If y is set equal to 2/0, u becomes a 
function of the single variable Xj namely, 

W = fix, yo). 

If this function has a derivative with respect to the variable a;, 
the derivative is called the partial derivative of /(rr, y) with 
respect to x, for y = 2/0. In like manner, if x is assigned a con- 
stant value xqj the derivative with respect to y of the resulting 
function /(rco, y) is called the partial derivative of fix, y) with 
respect to y, for x = xq. The customary notations for the partial 
derivative of u = f{Xj y) with respect to x are: 

1^' h{x, y), and 

The partial derivatives of a function f{xi, a;2, • • • , Xn)y of 
n independent variables, are obtained by fixing the values of 
n — 1 of the variables and calculating the derivative of the 
resulting function of a single variable. Thus, 

f{x, y, z) === yx^ — 2 yx + xz^ 

* See in this connection Hobson, E. W., Theory of Functions of a Real 
Variable, p. 408. 

t Analogous to the definition of the “neighborhood^' or “vicinity" of a 
point given in Sec. 3 for a function of a single variable, the totality of all 
points whose distance from a given point P is less than a given number 
€ > 0 is called a neighborhood of the point P. 
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has the partial derivatives 

dx 


Recalling the definition of the derivative of a function of a 
single variable, one can see that the expressions 

du 


and 


du 


define the partial derivatives of /(a;, y) at the point (a^o, 2/o)- 
Even though the notation — suggests a fraction, it must be 

(jjj 

noted carefully that it is merely a symbol for the partial deriva- 
tive, which does not find a sensible interpretation as a quotient 
analogous to that given for the ordinary derivative. 

Let Aw denote the change in the value of w = f{x, y) when x 
and y acquire, respectively, the increments Aa; and Ay, Then 

(23-1) Aw = f{x + Ax, y + Ay) - f{x, y). 

Adding and subtracting S{x, y + Ay) in the right-hand member 
of (23-1) give 

Aw == {f{x + Ax, y + Ay) - f{x, y -b Ay)\ + [f^x, y + Ay) 

" M y)l 

The expression in the first bracket represents the increment 
received by the function /(a;, y -j- Ay) when x undergoes a change 
of magnitude Aa;; whereas the second bracket gives the increment 
of the function f{x, y) when x is kept fixed. 

The application of the mean-value theorem gives 

f{x + Ax, y + Ay) - f{x, y + Ay) ^ f^{x -f Si Ax, y + Ay) Ax, 
f{x, y + Ay) - f(x, y) = fy{x, y + 62 Ay) Ay, 


where 61 and 62 are numbers between 0 and 1. Then Aw can 
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be written in the form 


(23-2) = S:o{x + Bi Lx, y + Ay) Lx + fy{x, y + Ly) Ly. 

If it is assumed that the partial derivatives and fy are 
continuous functions of x and y, then 

lim f^{x -h :Lx,y + Ly) = f:,{x, y), 

Aa— >0 
AJ /-+0 

and 

lim fyix,y 

Ay-^0 

The last two equations can be rewritten to read 


(23-3) 


/^(x + di Ax, y + Ay) = /,(x, y) -f iji 
Jy(x, y + di Ay) = fy(x, y) -h 


where jji and 7)2 tend to zero when Ax — >■ 0 and Ay ■ 
Substituting from (23-3) in (23-2) gives 


(23-4) 


nr nr 

-^Lx +-^Ly + r}iLx + 772 Ly, 


The sum of the first two terms in the right-hand member of (23-4) 
is called the principal part of the increment Lu, or the total 
differential of u, and is denoted by the symbol 


(23-5) 


du 




As in the case of a function of a single variable, the increments 
and the differentials of the independent variables are identical, 
so that dx = Lx and dy = Ly. 

Since rji and 972 are functions of Lx and Ly that tend to zero 
with Lx and Ly, the expressions 

r)i Lx and 972 Ly 

are infinitesimals of higher order* than Lx and Ly. Accordingly, 
for small values of Lx and Ly, the value of Lu is very nearly that 
of du.'\ 

* It will be recalled that a variable whose limit is zero is called an infini- 
cc 

tesimal. If lim^ = 0, where a and /3 are infinitesimals, a is said to be of 

higher order than jS. 
t See Prob. 6, p. 66. 
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Formula (23-4) is analogous to that developed in Sec. 15 
for the increment of the function of a single variable x, where it 
was found that 

Ay = f'{x) Ax + rj Ax. 

Since u —fix, y), (23-5) can be written as 

(23-6) du = ^dx + ^ dy. 

The extension of formula (23-6) to functions of any number of 
variables is immediate. If u — fixi, 0 : 2 , * • * , Xn), where 
Xi, X 2 j '• * , Xn, are the independent variables, the differential 
of u is defined as 


(23-7) 


du du 


Theorem. If xi, X2, • • • , are independent variables and 
u — fixi, X2j • ' ' , Xn) is continuous together with its partial 
derivatives, and if 


(23-8) 

then 


du = Piixi, :C2, ‘ , Xn) dxi + P2iXi, X2, • • 

P^ixi, X2j • * 





, Xn) dX2 
Xn) dXny 


Since the variables are independent, one can set 


dx2 = dxz— ’ • • = dxn = 0 


in (23-7) and (23-8) to obtain 


Thus 


du 


^dXi =PidXi 
dXi 


Pi 


du 


and so forth. 


Corollary. 


If du = 0 , then ^ 


du 


du 


= 0. 


PROBLEMS 

1 . Find the partial derivatives of the following functions : 

(a) log ix"^ + 2 /^ + 

(Jb) cos xy] 

(c) — 
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id) 




(e) 


iff) tan-'-; 




X — y 


x + y’ 

(i) sin y, 

2. Find the differentials of the following functions: 


(a) {x^ + + z^)y^; 

(b) {x^ + 

(c) X log (a;2 + Z^) ; 

(d) log tan {x^ + y ^) ; 


3. What are the values of the partial derivatives of 

X — y -{- 1 

z = — : r 

X + y - 1 

at (0, 0) ? 

4. Find the partial derivatives of 

X — r cos 6 sin (p, 
y = r sin 6 sin <p, 
z = r cos dj 

with respect to r, 6. and (p. 

5. If w = x^y •+ y^z + z% verify that 

du du du 
dx dy 

6. It was remarked in Sec. 23 that for small changes in the values of 
the independent variables the change in the value of the function is 
nearly equal to the magnitude of the differential. This fact can be used 
to calculate the approximate error in the quantity f(x, y, z) determined 
by measurements of y, and z. The error in /, due to small errors 
dx, dy, and dz in x, y, and z, is approximately equal to 

dx 


Show that the approximate relative error 


/ 


is equal to d log/. 
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7. Referring to Prob. 6, find the approximate error in calculating 

the area of a triangular piece of land, two sides of which are measured 
as 125 and 100 ft., respectively, and the included angle as 60.° The 
possible error in measuring the sides is 0.2 ft. and that in the measure 
of the angle is 1°. Hint: A = sin a. Ans. 74.0 sq. ft. 

8. In estimating the cost of a pile of bricks measured as 6 . X 50 X 4 ft., 

the tape is stretched 1 per cent beyond the estimated length. If the 
count is 12 bricks to 1 cu. ft. and bricks cost $8 per thousand, find the 
error in cost. Ans, $3.46. 

A 

9. In determining specific gravity by the formula s — where 

A is the weight in air and W is the weight in water, A can be read within 
0.01 lb. and W within 0.02 lb. Find approximately the maximum error 
in s if the readings are A = 1.1 lb. and W — 0.6 lb. Find the maximum 
As 

relative error — Ans, 0.112: 0.054. 

s 

10 . The period of a simple pendulum with small oscillations is 

If T is computed using I ~ S it. and g = Z2 ft. per second per second, 
find the approximate error in T if the true values are I = 8.05 ft. and 
g = 32.01 ft. per second per second. Find also the percentage error. 

Ans. 0.003t; 0.3 per cent. 

11 . The diameter and altitude of a can in the shape of a right circular 

cylinder are measured as 4 in. and 6 in., respectively. The probable 
error in each measurement is 0.1 in. Find approximately the maximum 
possible error in the values computed for the volume and the lateral 
surface. Ans. I.Ottjtt. 

12. Show that the relative error of the product is equal to the sum of 
the relative errors of the factors. 

24. Differentiation of Composite Functions. Let u = f{x, y) 
be a function of the variables x and y which in turn are functions 
of some independent variable t. If t is given an increment Ai, 
the functions x and y will acquire increments Lx and A?/, and, 
consequently, u will receive an increment Lu, 

Assuming that u = f(Xj y) is continuous together with its 
partial derivatives, one can write [see (23-4)] 

Au ^ ^ Lx + Ay + riiLx + m Ay, 
ox ay 

Dividing both sides of this expression by At gives 
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Now if it be supposed that x and y can be differentiated with 
respect to t, the expression (24-1) gives, upon passing to the limit 
as At 0, 


(24-2) 


du _ dudx du dy 

dt dx dt dy dt 

dx dt dy dt ' 


since 771 0 and 772 0. The reason for the vanishing of rji 

and 772 as > 0 is that 771 and 772 are functions of Ax and Ay, 
and since x and y are assumed to be differentiable functions of t, 
they are surely continuous in t. 

Formula (24-2) gives the rule for the differentiation of com- 
posite functions. It is clear that if is a function of a set of 
variables, xi, x^, ^ , Xn^ where each variable is a function of 

an independent variable t, the derivative of u with respect 
to t is given by the formula 


du _ du dXi du i 
dt ~~ dxi dt dX2 


+ 


du dxn 


A special case of formula (24-2) is of interest. If it is assumed 
that t = X, (24-2) becomes 


(24-3) 


du_du du dy 
dx dx dy dx 


Formula (24-3) can be used to calculate the derivative of the 
implicit function given by 


(24-4) (re, y) = 0. 

Let it be assumed* that (24-4) can be solved for y to yield a 
real solution 

(24-5) y = ip{x)-, 

then the substitution of (24-5) in the left-hand member of (24-4) 
gives an identity 0 = 0, or 

fix, cp{x)\ s 0. 

Thus the constant zero defines an implicit function of x, namely, 

* For general theorems regarding the conditions to be satisfied by /(x, y) 
if solution is to be possible, see Chap. XII. 
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(24-6) 0 = f{Xj y), where y = <p{x). 

Applying (24-3) to (24-6) gives 


and solving for 


dx 


(24-7) 


A _ t ^ ^ 

dx dy dx 


^1 

^ 

dx df 

dy 


The formula (24-7) implies that ^ must not vanish for the 

point {xo, yo) at which the derivative is calculated.-^ 

Example 1. Letf{x, y) — Sx^y^ + x cos y = 0, 

-£ = 9xY + oosy, ^ = -xsia. y, 

so that 

dy _ Q^ 2 y 2 QQg y 
dx Wy — X smy 

for all values of x and y that satisfy the equation 
Zx^y^ + X cos 2/ = 0, 
and for which &x^y — a; sin 2 / 5 ^ 0. 

Example 2, Let + 2 /^ = 0; then ^ = 2a;, ^ = : But 

it does not follow that 

dy X 

dx y 

This result is absurd inasmuch as the only real values of x and 

df 

y that satisfy a:® + ?/“ = 0 are a: = 0 and y ~ 0. Since ^ 

dv 

vanishes at this point, the formal procedure used in obtaining ^ 
is meaningless. 
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Example 3. Let/(a:, y) = 0 represent the locus of some curve 
and let yo) be some point on the curve. The equation of the 

tangent line to the curve at the point P is 


It follows from (24-7) that this equation can be written in the 
form 

— Vo) = 0. 


PROBLEMS 

1. Find the equation of the tangent line to the ellipse 

— 4 * — = 1 

^ 52 ’ 

at the point {xo, yo). 

2. Find the equation of the tangent line to the folium of Descartes 

— Zaxy = 0. 

Note particularly the behavior of the tangent line to the folium at (0, 0). 

^ . du .. 

3. Find — j if 


u = tan”"^ - and 

X 

4. Find the equation of the tangent line to the ellipse 

X = a cos 6j 
y = h sin 6, 

at the point where 6 = 

6. (a) Find if u ’ sin i and x — y = t — z = j ; 
du du 

(b) find — and — » if — 4^/^ a; = r sec 6, and y - r tan d. 

dr du 

du du 

6. (a) Find — and —7 if u = x'^ + y^ and y ~ tan x: 

dx ax 

Q>) given V = f{x, y, z), where x = r qos S^y = r sin 
^ dV dV dV . ^ ^dV dV , dV 

dr dd dt dx dy dz 

7. The equation of a perfect gas is pv ^ RT. At a certain instant a 
given amount of gas has a volume of 16 cu. ft. and is under a pressure of 
36 lb. per square inch. Assuming R = 10.71, find the temperature T. 
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If the volume is increasing at the rate of ^ cu. ft. per second, and the 
pressure is decreasing at the rate lb. per square inch per second, find 
the rate at which the temperature is changing. Ans. 53.78; 0.93. 

25. Difierentiation of Composite and Implicit Functions. The 

reasoning enaployed in the preceding section can be applied in 
obtaining the’ total differential, and hence the derivative, of a 
function of n variables 

u = f(xi, a: 2 , • * * , Xn), 

where 

= Xiit), {i = 1, 2, ■ ■ ■ , n), 

are n differentiable functions of a single variable t 
The resulting expression for the total differential is 

(25-1) du = — ^ dx 2 “h 

A question arises concerning the validity of formula (25-1) 
in the case where the variables Xi are functions of several inde- 
pendent variables ti, ^ 2 , * • * , tm- Thus, let 

(25-2) u = f{xi^ X 2 , * * 

be a function of the n variables Xi^ where the are functions 
of the variables iJi, if 2 , • • * , t-fiij say 

(25-3) — Xi(tlj ^2; } ^m); J' " * *3 ^)‘ 

If all of the variables except one, say 4, are held fast, (25-2) 
becomes a function of the single variable and one can calculate 

the derivative with the aid of (25-1). The notation 

otk <yh 

instead of is used to signify the fact that all variables except 
dtk 

tk are held fast. 

Assuming the continuity of the derivatives involved, one can 
write 


if ^ 

df dXi . df dXi 

dh dX2 dti ' ' 

df ^ 

df dXn 
dXn 

df d 

dXn dti 

dti 

dX2 dti 

df 

il. 

dXn 


. dtm dXz 

dXfi dtm 
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If M., M-, . . . , be multiplied respectively by dti, dh, 

dt\ dt^ Btm. 

■ ■ ■ , dim. and the resulting expressions added, one obtains 


if. 

dt 


■dh +^dU + ■ ■ ■ +if- di 


df 


dU 


dt„. 


dh + # + 


dx\dti 


dh 


, df ( dx^ , dx^ , , 

dxf\dti dh 

+ . 

+ 


dXr\dti 


dh 


+p‘“- 

dt-m, 

^ dX2 

+ -^dt, 

dtm 


■) 


^(^dk + ^-^dh + • • • + 


dx 

m. 


- dt^- 


The left-hand member of this expression is the total differential 
off(xi, X 2 , ■ ■ ■ , Xn), regarded as a function of the independent 
variables h, h, ■ • ■ , U, whereas the terms in the parentheses 
in the right-hand member are precisely the total differentials of 
(25-3). Hence, one can write 


dS = ^dxi + ^ dx2 + 

•' dXi dX2 




which shows that the formula (25-1) is valid whether the xfs are 
the independent variables or are functions of any set of other 
independent variables. 

The foregoing can be summarized as follows: 

Theorem. If u = f(xij X 2 , * * • , ^n), 
then 

du = dxi + dx2 + * • * + dxn, 
dxi dxz dXn 


regardless of whether the variables Xi are the independent variables 
or are functions of other independent variables tk. It is understood 

that all the derivatives involved ( the and ) are continuous 

\ dXk dtk/ 


functions. 

Example. If f{x, ?/) = -h y^j where x = r cos <p and 
2 / = r sin <pj then 


dr 


dx dr dy dr 


= 2x cos ^ ^ sin 

2r cos^ ^ -f 2r sin^ ^ = 2r, 
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— 2r® cos cp sin p + 2r^ cos p sin ^ = 0. 


2r At or 


2y dy. 


Let f(x, y, z) 0 define any one of the variables as an implicit 
function of the remaining ones. If x and y are thought to be the 
independent variables and one can obtain* (at least theoretically) 
a real solution for 2 in terms of x and y, it is possible to write 

But 

Substituting the value of dz in this equation gives 




^ 4 . A,, , A 

^dy dz dy) ^ 


By the corollary to the theorem of Sec. 23, since x and y are 
independent variables, 

dx dz dx 
and 

^ = 0 
dy dz dy 

If ^ 7 ^ 0, these equations give 


(25-4) 


The formulas (25-4) permit one to calculate the partial deriva- 
tives of the function z defined implicitly by an equation 

fix, y, z) = 0. 


* See Sec. 113. 
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As an illustration, let 

+ 2y^ — Sxz + 1 = 0. 

Then, by (25-4), 

dz 2x — T dz 4?/ 

dx —6x By —6x 


PROBLEMS 

Bu Bu 

Find -;p and — > if w = a; = r sec 6, and y = r tan 

Bt ou 

If 7 = fix, y, z), where x — r cos d, y = r Bin 6, z t, find 

^ ^ £7 
dr’ dd’ Bt 


, d7 d7 , d7 
m terms of -rp’ and p— 
dx By dz 

dv 

3. (a) Find -f j if a; sec ^ + x^y — 1; 

dx 

(b) find ^ and if 
da; By 

x^y ~ sin 55 + 2:2 = 

4. If / is a function of u and v, where w = \/a;2 + j/2 and v = tan“^ -> 



6. If / is a function of u and v, where w = r cos d and = r sin 6, find 



6. If a; = a;' cos d - 2/' sin 6 , y = x' sin d + ?/' cos 6 , prove that 

( 4 . 4 - 

\dxj \By/ \Bx'J \Byy * 

7. Find the total differential, if u - -{- y^, a: = r cos d, and 

y — r Bin 6. 

8. If / = e®*', where x = log ^ ^ 2 ) andi/ = tan”^ find” and — • 

V Bu Bv 
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01 9. If 2 = > M = 2 / sin X, and v = find and 

1 - MW ’ dx dy 

' . dz Sz X t/ 

I'ind — and “ ? if 2 = a; = tan (r — s), and y = 

. Euler’s Theorem. Afunction/of 7^ variables a;i, 0 : 2 , • * • , 
i called homogeneous of degree m, if upon replacement of each of 
3 variables by an arbitrary parameter X times the variable, 
3 function / is multiplied by X^. In symbols this means that 

b-1) f(\Xij 'KX2 j * * * j 'hXn) — X”^jr(cri, X2j * * * J 

bus, 

' Vj = x^ -y- — 2z^ is homogeneous of degree 2, 
f(x, y) — \/y‘^ — sin”^ ^ is homogeneous of degree 1, 


to 


/fe y) = % sin ? 


is homogeneous of degree 0, 
is homogeneous of degree 

2 


Theorem. If f(xi, 3 : 2 , • • • , Xn), with continuous • 'partial 
derivatives, is homogeneous of degree m, then 




+ a:n ^ = mf{xu x^, 




hXn. 


In order to prove this theorem, set 

x[ = Xa:i, X2 = Xx2, * * • , a;' 
Then, since / is homogeneous of degree m, 
f(xi, X2, * * = X^/(Xi, iTz, ‘ 

Differentiating with respect to X one obtains 


-\ ijr/. 


^ 2 , * 




and setting X = 1 gives the desired result (26-2) since 


PROBLEM 

Verify Euler’s theorem for 
(a) /(a:, y) =?= a / — x^ sin-i 

X 
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(b) f(x, y, z) = 

(c) f{x, y) = 


(cO f{x, y) 


Va; + 2/. 


(e) /fe 2/) 


— 2/2 


27. Directional Derivatives. The relation expressed in (24 
has an important special case when x and y are functions of x 
distance s along some curve C, which goes through the pot 
(x, y). The curve C may be thought to be represented by a pa 
of parametric equations 

X = x{s)^ 

y = y(s), 


where x and y are assumed to possess continuous derivatives with 
respect to the arc parameter s. 



Let P (Fig. 16) be any point of the curve C at which f{x, y) is 

defined and has partial derivatives ^ and — • Let 

dx by 

Q(x + Aa:, 2/ + Ay) 

be a point close to P on this curve. If As is the length of the 
arc PQ and A/ is the change in / due to the increments Aa: and 
Ay, then 


gives the rate of change of / along C at the point {x, y). But 
ds dx ds . by ds ’ 
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Ax 

-■ hm — = cos a, 
As-»0 As 


ds — >.0 A.S 


"efore, 


df df ,df. 

^ ^ cos a + ~- sm O', 

as dx dv 


id it is e^ddent that ^ depends on the directi 


direction of the curve. 


/or this reason is called the directional derivative. It 
ds 

'represents the rate of change of /in the direction of the tangent to 
the particular curve chosen for the point (a;, y). If o; = 0, 


ds dx 

which is the rate of change of / in the direction of the a;"axis. If 


ds dy y. 

which is the rate of change of / in 

the direction of the ^-axis. PCx^yjs^^^^ \ 

Let z = f(Xj y)j which can be \ ' 

interpreted as the equation of a \ 

surface, be represented by draw- 
ing the contour lines on the xy~ 
plane for various values of z. -pia. 17. 

Let C (Fig. 17) be the curve in 

the x^-plane corresponding to the value z = j, and let C + AC be 

A/ Ay . 

the neighboring contour line for 2; = 7 + A7. Then — = ^ is 

the average rate of change of / with respect to the distance As 
between C and C + AC. Apart from infinitesimals of higher 
order, 

— = cos 


where An denotes the distance from C to C.+ AC along the nor- 
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mal to C at (x, y), and 4' is tiie angle between An and As; henc 

dfi 

^ = COS xj/. Therefore 


(27-2) 


^ = =_ 
ds dn ds dn 




This relation shows that the derivative of / in any direction m 
be found by multiplying the derivative along the normal by t 
cosine of the angle xp between the particular direction and t 
normal. This derivative in the direction of the normal is calk 
the normal derivative of /. Its numerical value obviously is th 

maximum value which ^ can take for any direction. In applied 

mathematics the vector in the direction of the normal, of magni- 

tude is called the gradient. 


ds 


Example. Using (27-1) find the value of a which makes 
a maximum, considering x and y to be fixed. Find the 


expression for this maximum value of 
Since ^ — fx cos a + fy sin a, 


ds 


fa[l) = “• 

The condition for a maximum requires that 

tan ax == or tan^^ -- 

Using this value of ai, 

^ _ _ 

Vf.+fy'^'Wn'+fy 

The relation (27-2) can be derived directly by use of this expres- 
sion for If a (Fig. 18) gives any direction different from the 
direction given by ai, then 
df 
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— xp, SO that 

cos ^ + sin ai sin xp) + /»(sin ai cos xp 

— cos ai sin xp). 


COS ai 




sin ai = 





Fig. 18 . 


COS 4^ + fx — sin 


/n+fy Vff+fy 

+ fy COS ^ . sin 


cos 4/ = 


cos 


2L 

dn 

PROBLEMS 


1. Find the directional derivative of /(a:, y) — x^y + sin xy at 

in the direction of the line making an angle of 45° with the x-axis. 

2. Find 


if a; = r cos 0, 2/ = ^ sin 0, and /is a function of the variables r and 0. 
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3. Find the directional derivative of f{Xj y) — x^y + in the direc ■ 
tion of the curve which, at the point (1, 1), makes an angle of 30° wi' 
the a;-axis. 

4. Find the normal derivative of f{x, y) ~ x^ + y^- 

28. Tangent Plane and Normal Line to a Surface. It w. 

recalled that 

Ax + By + Cz — D 

is the equation of a plane, where the coeiEcients A, B, and 
are called the direction components of the normal to the plan 



If a, /?, and 7 (Fig. 19) are the direction angles made by the normal 
to the plane from the origin, then 

A 

cos oi = cos B = 

+ b^ + c- 

c 

cos 7 = 

+ B^ + C^ 

Therefore, 


cos aicos i3:cos y = A:B:C, 

If the plane passes through the point (xo, t/o, 2 ^ 0 ), its equation can 
be written as 


A{x — X{^ A" B{y — yo) C(z — zq) = 0. 

There is also a normal form for the equation of a plane, entirely 
analogous to the normal form for the equation of the straight 
line in the plane. This form is 


a; cos a + 2 / cos jS + 2 : cos 7 = p, 
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or 


+ B^ + + C^ 

D 

~Vb^ + c^ 


in which p = 


D 

Va^ + b^ + C2 


is 


the distance from the origin 


to the plane. 

Consider a surface defined by 2 = /(a:, y), in which x and y 
are considered as the independent variables. Then 


(28-1) 


dz = -fdx+^dy 
dx dy ^ 


If xo and 2/0 are chosen, Zq is determined by 2 = f{x, y). Let 
Ax = X — xo and Ay = y — 2 / 0 ? and denote & by 2 — Zq. Then 
(28-1) becomes 


(28-2) 3 - So = || 


. yo) 


which is the equation of a plane. If this plane is cut by the 
plane x == Xoj the equation of the line of intersection is 


2 - 2:0 = (y — 

(xo, yo) 

and this is the tangent line to the curve 2 = f{xo, y) at the point 
(a;o, 2/oj 2 : 0 ). Similarly, the line of intersection of the plane defined 
by (28-2) and the plane y = yo is the tangent line to the curve 
2 = f(Xj yo) at {xq, yoj zo). The plane defined by (28-2) is called 
the tangent plane 'to the surface 


at (xo, yo, zo). 

The direction cosines of the normal to this plane are propor- 
tional to 




t 


dx| I j/o) 
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The equation of the normal line to the plane (28-2) at (xo, 2/0, 2o) 
is therefore 


(28-3) 


X — xo ___ y — yo _ z — zo 

:o, 1 / 0 ) 


This line is defined as the normal to the surface at (xo, 2/0, ^0). 
Figure 20 shows the difference between dz = RP' and Az ~ RQ. 



P{xoy 2/0, zq) is the point of tangency and R(jxq + Ax, 2/0 + Ay, Zo) 
is in the plane z = Zq. PP' is the tangent plane. 

In case the equation of the surface is given in the form 

F{x, y, z) = 0, 

the tangent plane and the normal line at (xo, yo, Zo) have the 
respective equations 


(28-4) 


dx 


{zo, yo, so) 


(x - Xo) + 


dy 


and 


{y - 

' 0 . So) 

dF\ 

. ya, zo) 


— So) = 0 


(28-5) 


X — _ y — yo __ z — Zo 

^ dF\ 

dy i(OT, yo, So) l(xo, yo, So) 


These equations follow directly from (25-4). 
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Example 1. At (6, 2, 3) on the surface + 2 ® = 49, 

the tangent plane has the equation 

2x (a: - 6) + 2y\ {y - 2) + 2zj (2 - 3) = 0 

(S. 2 . 3) 1(6, 2. 3) 1(6. 2, $) 

or 

■ + 2y + 3z = 49. 

The normal line is 

X — 6_y — 2^z — 3 
12 4 6 ■ 

Example 2. For (2, 1, 4) on the surface 2 = a:* + 2/* — 1, the 
tangent plane is 

— 4 = 2a: (a; — 2) + 2y\ {y — 1) 

,(2. 1) 1(2, 1) 

or 

2y- 6. 

The normal line is 

a: — 2 — 1 2 — 4 

PROBLEMS 

1. Find the distance from the origin to the plane x + y + z = 1, 

2. Find the equations of the tangent plane and the normal line to 

(а) 2x^ + 32/2 + 42^ = 6 at (1, 1, 

7/2 «i2 

(б) |+|-^ = lat(4,3,8); 

. . a:* y® 2^ . 

^ ^ 1 ®'t ( 20 , yo, zo). 

3. Referring to (28-4), show that 

^ dF BF BF 

cos a: cos p: cos y = — 

Bx By Bz 

where cos a, cos cos y are direction cosines of the normal line. 

4. Show that the sum of the intercepts on the coordinate axes of any 

tangent plane to -f 2 ^ = is constant. 

29. Space Ctxrves. It will be recalled that a plane curve C 
whose equation is 

(29-1) 


y = fix) 
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can be represented in infinitely many ways by a pair of parametric 
equations 

(29-2) * ^ 

2 / = 

SO chosen that when the independent variable t runs continuously 
through some set of values ti ^ t the corresponding values 
of X and y determined by (29-2) satisfy (29-1). 

For example, the equation of the upper half of a unit circle 
with the center at the origin of the cartesian system, 


can be represented parametrically as 
X = cos ty 

y = sin ty (0 < t < x), 

or 

{0^t< 1 ), 

or 

X — 2t, 

y = {QSt< K). 

Similarly, a space curve C can be represented by means of a 
set of equations 

X = x{t), 

(29-3) y = 2/(0, 

2 = z(0, 

so selected that when t runs through some set of values, the 
coordinates of the point P{x, y, z), defined by (29-3), trace out 
the desired curve C. 

It win be assumed that the functions in (29-2) and (29-3) 
possess continuous derivatives with respect to t, which implies 
that the curve C has a continuously turning tangent as the point 
P moves along the curve. 

Let P{xt, yo, Zo) (Fig.' 21) be a point of the curve C defined by 
(29-3) that corresponds to some value to of the parameter t, 
and let Q be the point (xo -t- Aa:, yo -|- Ay, zo -|- Az) that cor- 
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responds to f = io + Ai. The direction ratios of the line PQ 
joining P and Q are 

,jy,^ _ Ax_Ay 

Ac' Ac' Ac At' At' 

If At is allowed to approach zero, Ax, Ay, and Az all tend to zero, 
so that the direction ratios of the tangent line at P{x<^, yo, Zo) 



are proportional to 



tion of the tangent line to (7 at P is 


Hence, the equa- 


X — xo _ y — yo z - Zo 
x'{to) y\to) z'ito) ’ 

where primes denote derivatives with respect to t. 

Example. The equation of the tangent line to the circular 
helix 


X == a cos t, 
j/ = a sin t. 
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6 

a ira 

^ 2^6 
2 

The element of arc ds is given by 

(dsy = (dx)^ + (dyy + (dzY, 

so that the length of a space curve C can be calculated from 


The length of the part of the helix between the points (a, 0, 0) 



30. Directional Derivatives in Space. There is no essential 
difficulty in extending the results of Sec. 27 to any number of 
variables. Thus, ii u = f(Xj y, z) is a suitably restricted func- 
tion of the independent variables x, y, and Zj then the directional 
derivative along a space curve whose tangent line at some point 
P(Xj y, z) (Fig. 21) has the direction cosines cos [x^ s'), cos (y, s), 
and cos (z, s) is 


du du . . , du f 

^ = (x,s) + ^cos(j/, 

_ du dx . dudy . du dz 
““ dx ds~^ dy ds dz ds 


— 

dz 


cos {z, s) 


The magnitude of the normal derivative is given by 


(30-1) 


PROBLEMS 

1. Find tte equation of the tangent line to the helix 
X = a cost, y = asint, z = at, 

IT 

at the point where t = -• Find the length of the helix between the 
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2. Find the directional derivative of / = xyz at (1, 2, 3) in the direc- 
tion of the line that makes equal angles with the coordinate axes. 

3. Find the normal derivative of / == {1, 2, Z). 

4. Show that the square root of the sum of the squares of the direc- 
tional derivatives in three perpendicular directions is equal to the 
normal derivative. 

6. Express the normal derivative (30-1) in spherical and cylindrical 
coordinates, for which the equations of transformation are 
(a) X = r sin 6 cos cp, y — r sin d sin (p, z — r cos 6; 

Q)) X T sin By y = r cos dj z ^ z. 

31. Partial Derivatives of Higher Order. The first partial 
derivatives of a function /(xi, 0 ^ 2 , • • • , Xn) are functions of 
Xu X 2 , * Xn and they may have derivatives wdth respect to 
some or all of these variables. These derivatives are called 
second partial derivatives. 

If there are only two variables x and y the function u = f{x, y) 
may have the second partial derivatives 



y. Thus ■ ' and ■ differ in the order in which the differ- 

^ dy dx dx dy 

entiation is performed, and, consequently, the results may be 
different. The following theorem, due to Schw-arz,* states 
sufficient conditions for inversion of the order of differentiation. 

Theorem. If f^, fy, and f^^ exist in the vicinity of the point 
{Xj y) and if f^y is continuous at {x, y), then fy^ exists at this point 
and is identical with f^y 
Form the function 

(31-1) <p(x) = fix, y + k) - fix, y), 

* De la ValliSe Poussin, C. J., Cours d’analyse infinit^simale. vol. 1, 
p. 146. 
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§31 


which for a fixed y and k satisfies the conditions of the mean- 
value theorem. Hence, making use of (20-4), 

<p{x + h) — (p{x) = hipx(x -|- dji) 

= h[f^(x + dJi, y + k) — fx(x + dih, y)], 

where 0 < < 1. 

The expression in the brackets is a function of y to which the 
mean-value theorem is applicable, so that 

fx{x 4- e-Ji, 2 / -f i) — fx{x + dxh, y) = kfxy(x + dJi, y + Oik). 
Since /ij, is assumed to be continuous at {x, y), 

fxyix -i- dJl, y 4- 02 ^) = fxy{x, y) -]- €, 

where 

lim 6 = 0. 

h-^O 

k->0 

Therefore, 

(31-2) <p(x + h) — ip(x) = hk[fxyix, y) 4- «]. 

From the defining equation (31-1) it is seen that (31-2) is 
equivalent to 

Six + }i,y + k) - fix + h, y) - fix, y + k) + fix, y) 

= hk[f,,yix, y) 4- e]. 

Dividing through by k gives 

fix + h,y-\-k) - /(x 4- k, y) fjx, y + k) - fjx, y) 
k h 

= k[f:xyix, y) 4- e]. 

Passing to the limit as A: ^ 0, one obtains 

fyix + h,y)- fyix, y) = hf^yix, ?/) 4- A lim e, 

fc— >0 

or 

fyjx + h, y) - fyjx, y) ^ _ 

The limit of this expression as A 0 is 

fyxiXj y) = fxy{^) 2 /). 

Thus the order of differentiation is immaterial if the assump- 
tions regarding the partial derivatives are satisfied. These con- 
ditions certainly will be satisfied if it is known that fx and fa 
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possess derivatives and fyx which are continuous functions. 
The theorem is true under less restrictive conditions, but the 
detailed statement of these conditions is so involved that it will 
not be given here.* 

From the result just established it is clear that 


fxx!/(.^! y) fyxxi,^] y)] 

if these partial derivatives are continuous. For 


fxxyi^t J/) 


V) ^ y) ^ 

dy dx dx dy ^ 


x,y) = , 


y)- 


32. Higher Derivatives of Implicit Functions. The problem of 
calculating the derivative of y with respect to x when y is an 
implicit function of the independent variable x defined by 

(32-1) fix, y) = 0, 

was discussed in Sec. 24. It was shovm there that 


(32-2) ^ 

dx 

Differentiating this equation again and assuming that all the 
derivatives involved are continuous functions of x and y, gives 

(32-3) X, y) -i- 2fxyix, y) ^ t, y)(^ 


fy(^j 2 /) 5 ^ 0 at the point where the derivative is desired, 
“3) can be solved for - 
from (32-2). The result is 


d/u 

(32“3) can be solved for ^ and the value of ~ substituted 


2 

W ^ Jl 

The process can be continued to obtain the derivatives of higher 
orders. 

A similar procedure can be employed to calculate the partial 
derivatives of a function z of two independent variables x and y 
defined implicitly by an equation of the form 

(32-4) fix, y, z) = 0. 


* See E. W. Hobson, Theory of Functions of a Eeal Variable, vol. 1, 
pp. 424r~429. 
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Differentiating (32-4) with respect to x and y in turn gives 

bz . 

(32-6) 


K fz(Xj y, z) does not vanish for those values of Xj y, and z that 

aatisfy (324), then Eqs. (32-5) can be solved for ~ and ~ 

Partial derivatives of higher order can then be obtained by differ- 
entiating equations (32-^;. 

Example. Let it be required to find the derivatives of second 
order of the function z defined implicitly by the equation 


x^ 

62 + ^2 


= 1 . 


Differentiating this equation with respect to x and y gives 
2x . 2zdz ^ 


(32-6) 


• - 9 . 


0 . 


Differentiating the first of Eqs. (32-6) with respect to x and y, 
one obtains 


2 . 2 / 


2 dz dz ^ 5^ 
dx dy 


In a similar way the differentiation of the second of Eqs. 
(32-6) with respect to y yields 


Y 
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1. Verify that = 

dx ay 

(a) f = cosxy^; 

(b) f = sin^ X cos y; 

(c) / = 

(d) f = + y^)^] 

(e) / = (x2 _ 2yY 4 


PROBLEMS 

ay , 

a a for 

ay ax 


2, Prove that if 


(o) f{x, y) = log {x^ + 2 / 2 ) + tan-i ^ then 4r, + ^ = 


/(a:, y, e) 


dx- 


3. Find y', y", y"\ if — 3axy = 0. 


4. Find 

ox 
dz 


dx dy dx^’ dx dy 52/2 1)- if 


+ 1 . 


Find -^7 if 
dx 


(a) xz’^ — 2/^2 2;^% — 5 = 0; 

(&) a:;s3 _ 2/;^ + 3a;2/ = 0. 

33. Change of Variables. In a great variety of problems in 
analysis it is required to express the derivatives of a given func- 
-tion of one set of variables in terms of another set of variables. 
Some of the simpler problems of this sort were discussed in Secs. 
24 and 25. This section contains a formal treatment of several 
of the more difficult of such problems. The question of the 
existence of solutions of the equations to be considered in this 
section will be left open until Chap. XII, where the problem 
of the differentiation of implicit functions will be reexamined 
in the light of the existence theorems established there. 

The sole purpose of the present section is to develop manipula- 
tive skill in calculating the derivatives of implicit functions and 
to indicate the formal modes of attack on the problem. The 
continuity of the functions and their partial derivatives is 
assumed throughout this section and will not be referred to again. 

Let 


(33-1) = /(w, ?;) 

denote a function of two independent variables u and v, and 
suppose that u and v are connected with some other variables 
X and y by means of the relations 
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= xiu, v), 

*[ 1 / = y{u, v). 

If the equations (33-2) are solved for x and y to yield 


(33-3) 


'u = u{x, y), 
V = v(x, y), 


and the expressions (33-3) are substituted in (33-1) for u and 
Vj there will result a function of x and y, say, 

(33-4) w Fix ^y). 

The partial derivatives of w with respect to x and y can be 
calculated from (33-4) directly, but frequently it is impracticable 
to effect the solution (33-3), and it is desirable to consider an 
indirect mode of calculation. By the rule for the differentiation 
of composite functions. 


(33-5) 


du dx du dy du 

dw _ dw dx dw dy 

dv dx dv dy dv 


The partial derivatives and ^ can be calculated 

du du dv dv 

from (33-2), and hence they may be regarded as known functions 
of u and v. The partial derivatives in the left-hand members 
of (33-5) are also known functions of u and v since they can be 
calculated from (33-1). 

Hence, equations (33-5) may be regarded as linear equations 
for the determination of and Assuming that 


— ^ 

du du 

dx dy 

dv dv 


and solving by Cramer^s rule gives 



dw 

dy 


du 

du 


dw 

dy 

dw 

dv 

dv 

dx 

J{u 




dx 

dw 


du 

du 


dx 

dw 

dw 

dv 

dv 

dy 

Jiu, v) 
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The resulting expressions for — and — are known functions 

dx ay 

of u and v and thus can be treated exactly like (33-1) if it is 
desirable to calculate the derivatives of higher orders. 

As an example, consider the function w{r, 6), and let it be 
required to calculate the partial derivatives of w with respect to 
X and 2/, where x = r cos 6 and y = r sin d. Now 


dr dx dr 
dw _ 

W' dydd 


Solving these equations for — 
gives 


dy 

dw . dw . 

— — r sm ■ —r cos 

dx dy 

^ dw . , . dw 

and — in terms of — 
dy dr 



dw 

, dw 

sin 

6 dw 

dx 

dr 

r 


dy dr ^ 

r 

~W 


The function J is, in this case, 

I cos B sin ^1 


= r, 


—r sin B r cos d\ 


which does not vanish unless r = 0. 

As a somewhat more complicated instance of implicit differ- 
entiation, consider a pair of equations 


(33-6) 


'F{x, y, u, v) = 0, 
G{x, y, u, v) = 0, 


and let it be supposed that they can be solved for u and v in 
terms of x and y to yield 

/qq 7N y): 

The partial derivatives of u and v with respect to x and y can 
be obtained in the following manner. Considering x and y as 
the independent variables and differentiating equations (33-6) 
with respect to x and y gives 
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dF ] \ “O’ -L — 

, dx du dx dv dx ^ By Bu By Bv By 

(dd-8) ^ ^ 

Bx du Bx Bv Bx ^ By Bu By Bv By 

Equations (33-8) are linear in 0; —j and ~ 

As a consequence of the hypothesis that Eqs. (33-6) possess 
the solution (33-7), it follows that 


J(u, v) = 


dF 

dF 

du 

dv 



du 

dv 


in the region for which the solution (33-7) is valid.* Accord- 
ingly, the partial derivatives in question can be determined from 
(33-8) by Cramer’s rule. 

A special case of Eqs. (33-6) is interesting. Let 

^ = f(u, v), 

y = 9 {u, v). 

Differentiating these equations with respect to x and remembering 
that X and y are independent variables, one obtains 

I ^ I 

Bu Bx Bv Bx 


These equations can be solved for — and — ^ if 

Oju uX 

Bv 
Bv 

Example 1. Let 


J(u, v) = 


Bu 

Bu 


^2 _ ^2 _|_ 2 a ; = 0 , 

uv — y = 0, 

* The proof of this assertion is given in Chap. XII, 
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Differentiating with respect to x. 


du 

dx 


dv 




du , dv 
}— + = 


0 . 


Hence 

du u dv 

dx u^ + v^' dx + 2^2 

Differentiating the first of these results vdth. respect to x gives 

du , di^ 

\u 


dx^ 


(^2 + ^ 3)2 


d ^v d ^u 

One obtains similarly 


Example 2. Let 


dx^ dx dy 


and higher derivatives. 


(x = u + V, 


Differentiating with respect to rr, 


_ du , dv 
~ dx dx 


so that 


du 


It is easily checked that 

du ^ — „i 

Equations (a) can be solved for u and v in terms of x and 
and the result is 

u = -2x + y, 

V = Zx — y. 
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Eegarding w and « as the independent variables and differentiat- 
ing these equations with respect to u, one finds 


0 _ 3 ^ 

^ ~ du du 


Hence, 


— 1 
du "■ ' 


= 3. 
du 


It should be noted that and are not reciprocals in general, 

as, of course, is obvious from (33-9). 

Exo/mpls 3. If w ~ uv and 

+ V + X = 0, 

— u — y = 0, 


one can 


obtain — as follows: Differentiation of w with respect 


dx 


to X gives 


dx 


b V ^ 

dx dx 


The values of ^ and ^ can be calculated from (&) as was done 

ujj Ou/ 

in Example 1. The reader will check that 
dw u + 


dw 

^ 1 + 4cuv dy 

PROBLEMS 


— V 

^uv 


du dv du 

n + 1,2 + 2/2 - 2a; = 0, -h 3?/ = 0, find^. 

, dv 
and 

„ ~ , dw dw u 

2. Fmd — and — . if 10 = -> 

dx dy V 


\x - u + V, 
ly = Su + 2v, 


and 
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3. Show that if f{x, y, z) = 0, then ^ ^ = 1 aiid ^ = ~1- 

dx dz dyazax 

3z Sx 

Note that in general ~ and — are not reciprocals. 
ox dz 

3x Oif Sx Sy 

4. If ^ = x(Uj v)j y = y{u, v), and ^ and — = then 


S^w S^w __ ( S‘^w 

Su^ Sv^ \ Sx^ dy^ 


4- ( — Y 

'A\^/ 


5. Show that the expressions 


upon change of variable by means of 

tc = r cos d, 
2/ = r sin d, 

become 


and 

6, Show that 



SW 


il V = f(x + d) + g{x — d), where/ and g are any functions possessing 
continuous second derivatives. 

7. Show that 

•if X = cos Bj y — sin i 

8, Eind if 

— + 32/ = 0, 

— t/2 — 2a; = 0. 
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9. Prove that 


^ _ 0 
dx du dx dv ’ 


if F{Xj Uj v) = 0 and Gix, y, u, v) = 0- 

10. If Vi(Xj yj z) and V^ix, y, z) satisfy the equation 

Q 2 y ^27 ^27 

V27 = ZJL + ^ 4. zJL ^ 0, 

dx^ dy^ ds2 ' 


U ^ Vi{x, y, z) + + y^ + z^)V 2 (Xj y, z) 

satisfies the equation 

== 0 , 


where 


— 4^ — 
dx^ dy^ 



CHAPTER IV 
DEFINITE INTEGRALS 


34. Riemann Integral. The concept of a definite integral had 
its origin in problenas dealing with the determination of the area 
under a curve. Despite the fact that the refined concept of 
what is known as the Riemann integral is very far removed from 
the geometrical notions that led to its definition, it seems desirable 
to begin the study of Riemann integration by presenting a rea- 
sonably careful definition of the definite integral based on the 
intuitive concept of the area under the curve. An analytical 
definition of the Riemann integral is gi^n in the next section. 



The function j{x) considered in this section is assumed to be 
continuous and single-valued. Let the interval of definition 
of the function he a < x < b, and assume that the graph of 
the function lies above the a:-axis. The area bounded by the 
curve y = f{x), the rn-axis, and the lines x = a and x = b will 
be denoted by S (Fig. 22). Divide the interval (a, b) into n 
parts by the points 

Ct — Xqj Xij X2j * * * 3 1, Xfi ~ h) 

whose abscissas satisfy the inequality 

Xi < Xi+i, (f = 0, 1, 2, • • • , n - 1), 

99 
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and draw through these points of subdivision a set of ordinates 

Vh y2j * ‘ ' 5 yn~i> 

The area S will be divided into n vertical strips, the zth one of 
which has a base of length Axi = — Xi^i and an area ASi. 

Denote the maximum and the minimum values of the function 
y = f{x) in the interval Axi by Mi and respectively, and con- 
sider the rectangular areas 

Mi Axi and Mi Axi, 

Clearly, 

rrii Axi < ASi ^ Mi AXi, 
so that the area S is not less than 

n 

(34-1) AXi, 

i — 1 

which represents the sum of the areas of the inscribed rectangles. 
On the other hand, the area S is not greater than 

(34-2) Sn i 

which stands for the sum of the areas of the circumscribing 
rectangles. Therefore, one can write 

(34-3) Sn<S^ Sn. 

The difference between (34-2) and (34-1) is 

n 

(34-4) /S„ — Sn = {Mi — m,) Axi, 

i = l 

and if the number n of subdivisions is increased indefinitely 
in such a way that all of the subintervals Axi 0, the difference 
Mi — mi will also tend to zero, since f{x) is continuous. It 
does not foUow without proof that Sn — Sn will tend to zero, 
since the number of terms in the sum increases with the increase 
in n. It will be shown, however, that this is the case. 

Consider the set of numbers 

Mi - mi, (z = 1, 2, • • • , n), 

associated with some particular mode of subdivision of (a, b) into 
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n parts, and denote the greatest of these numbers by d„. Then 
the sum in (34-4) certainly will not be decreased if each Mi — m,- 
is replaced by so that 


n 

Sn -- Sn ^ dn^ AXi = dnib — o) , 

t = l 


But Sn Sn is nonnegative, so that 


and since dn 


or 


0 < Sn — Sn dn{b — u), 

0 when oo ^ it follows that 
lim (^Sn ~ 0, 


lim Sn = lim 

n— > 00 n—^ 00 


The area S, under the curve y = f{x), as is seen from (34-3), 
is intermediate to s„ and Sn, and since both s„ and Sn have the 
same limit, it is clear that their common limit is S. Thus, 

lim s„ = lim Sn = S. 

71—* =0 n-*- 00 _ 

Moreover, let be any point in the interval Axi, and form the 
sum 

71 

S'n = 

i = 1 


which represents the sum of the areas of rectangular strips whose 
heights are intermediate to mi and Mi, so that 

Sn< Si, < Sn. 


Since 


lim Sn = lim Sn = S, 

n— » 00 n— )■ 00 

it follows that 


lim ;S' = S, 


Hence, the sum S^ may be constructed for an arbitrary choice of 
the point in the subinterval Axij and its limit will be the same. 
This leads to the following definition: 

Definition. Let f(x) he a continuous function defined in the 
interval a < x ^ h. Let the interval {a, b) he divided into n sub- 
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intervals by inserting the 'points of subdivision Xi in such a way that 

a ^ Xo < Xi < X2 < • * * < Xn^l < Xn ^ b. 

Let be any point in the interval of length Axi — Xi — Xi^i. The 
limit of the sum 

n 

i = l 

as n—^ ^ in such a way that the greatest AXi 0, is called the 
Riemann definite integral of f(x) between the limits a and 6. It is 
denoted by the symbol 


£f{x) dx. 



The geometrical reasoning that led to the definition of the 
integral of Riemann involved an assumption that f{x) is a non- 
negative function. The fact that this assumption is not an 
essential one can be seen from the following considerations. 
Assume first that fix) is negative throughout the interval (a, &). 
Then each term in the sum 


Aa;.- 

i==l 

is negative, and the limit of the sum will be a negative number. 
Hence, areas l3dng below the a;-axis must be reckoned as negative. 

If f{x) is not always of the same sign, denote the smallest value 
oif(x) in (a, 6) by — m (Fig. 23). Then the function 

F{x) = f(x) + m 
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is positive or zero throughout the interval {a, b), and one can form 
the integral of F{x), namely, 

F(x) dx = 

n 

CO 

^ = 1 

n n 

— lim Lxi + lim V m hXi. 

n-> 00 ^ n -^ 00 

2=1 1=1 

The second term in the right-hand member of this equation gives 
m(b — a), and if the integral of F{x) exists, 

n 

lina 

n— > Qo 

1 = 1 

will surely exist. 

The restriction that a be less than h likewise can be removed. 
Thus, suppose that a > 6, and let the interval (6, a) be sub- 
divided into n parts by the points Xi such that 

a = X^> Xi> x^> ^ > Xn^i > Xn^h. 

Then the difference 

Xi — Xi^i = Axi 

is negative, so that the value of the sum 

n 

Axi 

i=l 

will differ only in sign from the corresponding sum appearing in 
the definition. Hence, 

dx = 

In view of this relation (as well as from the geometrical inter- 
pretation of the definite integral), it appears sensible to say 
that 

= 0 * 

It should be noted that the value of the definite integral 
f f(x) dx is a number S which certainly does not depend on the 
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choice of the letter used to denote the variable of integration. 
Consequently, the letter denoting the variable of integration 
can be changed at will. Thus, 

f^ix) dx = f^ii) dt. 

The foregoing discussion was restricted to the consideration 
of continuous functions only. However, the limit of the sum, 
figuring in the definition, may exist and be independent of the 
mode of subdivision of the interval (a, 6) into subintervals Axi 
(as well as of the choice of ^0, even if f(x) is not continuous.* 
Any function for which the integral of Riemann exists is said to 
be integrahle in the sense of Riemann. 

It is left to the reader to show: 

(a) That whatever le the choice of the three numbers a, b, and c, 

£f(x) dx = ff(x) dx + fy{x) dx; 

(b) That iffiix) andU{x) are two integrahle functions, then 

+M^)] dx = £fi{x) dx + dx; 

(c) That if fix) is an integrahle function and c is any constant, 
then 

fcfix) dx = dx; 

id) That if \f(x)\ denotes the absolute value of the integrahle 
function f [x ) , then 

35. Riemann Integral (Continued). The existence of the com- 
mon limit S of the sums s„ and Sn in Sec. 34 hinged upon the 
geometrical concept of the area bounded by the curve y = f{x), 
the ordinates x = a and x = h, and the a:-axis. A geometrical 
argument does seem convincing enough until one begins to 
inquire carefully into the possibility of graphical representation 
of continuous functions. It was indicated above that one need 


See Sec. 35. 
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not go very far out of his way to meet some continuous functions 
which cannot be represented graphically. The function 

f(x) — X sin i if X 9 ^ 0, 

= Oj if ^ == 0, 

in the vicinity of the origin is one such example. The reader may 
be inclined to disregard the seriousness of the situation since 
this function misbehaves only at one point of the interval, namely, 
where it fails to have a derivative, but it Tvas demonstrated by 
Weierstrass that 'there are continuous functions that fail to have 
a derivative at any point of the interval. Such pathological 
behavior of continuous functions led to a careful inquiry into 
the meaning of such geometrical concepts as the area under a 
curve, the length of arc, the volume, etc., on w^hich a considerable 
portion of analysis rested until the latter part of the last century. 
An offshoot of this inquiry was the theory of functions of a real 
variable, which is characterized by a complete absence of intuitive 
geometrical concepts. The exact meaning of the concept of the 
area under a curve is thus made to depend on an analytical 
definition of the definite -integral, rather than the other way 
round. 

A brief outline of the analytical definition of the Riemann 
definite integral, together with the statement of some important 
theorems, is contained in this section. The treatment is neces- 
sarily condensed and glosses over some of the more intricate 
points, which properly must be deferred to a course in the theory 
of functions of a real variable. 

If the elements of a given set of numbers (E), when represented 
by points on the number axis, possess the property that there 
are no points of the set (E) to the right of some fixed point, then 
the set is called bounded on the right, or bounded above. If, on 
the other hand, there are no points of the set {E) to the left of 
some fixed point, then the set {E) is bounded below, or bounded 
on the left For example, the set of positive rational numbers 
is bounded oii the left but is unbounded above. The set of 
negative rational numbers is bounded above, but not below. A 
set of real numbers between 0 and 1 is bounded above and below. 
Every set bounded above and below is said simply to be bounded. 
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If a set of numbers {E) has the follomng properties: 

{i) there is no number of the set (E) which is greater than some 
number M; 

iii) there is at least one number of the set (E) which is greater 
than ilf — where e is an arbitrarily small positive number, 
then the number M is called the upper bound of the set (E). 

On the other hand, if the set (E) possesses the properties: 

(i) that there is no number of the set smaller than some number m; 

(ii) that there is at least one number of the set (E) which is 
less than m + €, however small the positive number e may he, 
then the number m is called the lower bound of the set (E ) . 

If one cares to take advantage of the suggestiveness of the 
language of geometry, then the meaning of the upper and lower 
bounds of a set of numbers is the following. The points of the 
bounded set {E) all fall in a segment of finite length, and the 
numbers m and M are the end points of the segment. It appears 
from this remark that every bounded set necessarily must have 
the upper and lower bounds. A rigorous arithmetical proof of 
this fact is based on the study of the linear continua and is not 
given here.* 

Denote the set of values assumed by the bounded function 
f(x) in (a, b) by (E). Then the upper and lower bounds of the 
set (E) are called the upper and lower bounds of f(x) in (a, 6). 
Let M and m be the upper and lower bounds of a bounded func- 
tion f(x) defined in the interval (a, h), and let (a:i, ^ 2 ) be any 
subinterval contained in (a, b). Then the upper bound of f(x) in 
(xi, 0 : 2 ) certainly wiU not be greater than M, and the lower bound 
will not be smaller than m. Hence, if the interval (a, b) is sub- 
divided into n subintervals, and if the upper and the lower bounds 
of f(x) in each of the subintervals are denoted by Mi and mi, 
respectively (i = 1, 2, * • • , n), one is assured that m* > m 
and Mi < M. This fact is of basic importance in what follows. 

Let the interval (a, b) be divided into n subintervals by the 
points 

a^x^ <Xi<Xz< • • • < Xn-l <Xn^b, 
and form the sums 


* See, for example, E. W. Hobson, Theory of Functions of a Real Variable. 
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• AXi. 

The sums S and s depend on a particular mode of subdivision 
of (a, b) into n parts, but for each particular mode of subdmsion 
s S S, since < Mi. 

Consider the set of numbers S corresponding to all conceivable 
modes of subdivision. No matter what mode of subdi\dsion is 
chosen, 

(35-1) S = < M(h - a), 


since Mi < M and Axi = b — a 
Similarly, 

(35-2) > m(Jb - a). 

Now, since 


it follows from (35-1) and (35-2) that 


and 


m(5 — a) < S < M{b — a), 
m(5 — a) ^ s < M{b — a). 


These inequalities state that for any mode of subdivision of the 
interval (a, b) into n parts the sums S and s lie between m{b — a) 
and MQ) — a), and therefore the sums S have the lower bound, 
say J, and the sums s have the upper bound, say 1 . From the 
definition of these bounds it follows that 


and 


J .< 
I > 


If each of the intervals Axi (in any particular subdivision) is 
subdivided further by inserting additional points and the new 
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sum nS is formed for this larger number of subdivisions, then this 
new sum cannot be greater than the old 8", and in general it will 
be less. Moreover, the sum S arising from any mode of sub- 
division of (a, 6) will not be less than the sum 5 resulting from 
this or any other mode of subdivision. This leads one to sus- 
pect that when the number n of subdivisions is increased indef- 
initely in such a way that each Axi 0, the sum S tends to a 
definite limit which is independent of the mode of subdividing 
{a, h) into subintervals AXi, and that this limit is /. 

On the other hand, s will in general increase with the increase 
in the number of subdivisions, while remaining less than or equal 
to S, so that it is likely that its limit is I. The correctness of 
these surmises was established for the first time in 1875 by the 
French mathematician Darboux, who enunciated the following 
theorem: 

Theorem. The sums S and s tend to definite limits J and I, 
respectively, when the number of intervals AXi increases indefinitely 
in such a way that each and every AXi 0. Moreover, I < J. 

The proof of this theorem is given in books on the theory of 
functions of a real variable.* The numbers J and I are called, 
respectively, the upper and lower Riemann integrals of f{x) in 
(a, b). 

From the definition of the upper and lower bounds it follows 
that if is any value of x in the interval Axi, then 

Mi S /(!,•) ^ Mi. 

Therefore, 


and if it should happen that 

n n 

lim V mi Axi = Um V Mi , 

71 —^ 00 n— > eo 

2=1 2=1 

.that is, if 7 — /, then the sum 


See Hobson, E. W., The Theory of Functions of a Real Variable, vol. 1, 
3d ed., p. 462; de la Vallee Poussin, C. J., Cours d’analyse infinit^simale, 
vol. 1, 3d ed., p. 250. 
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will have the same limit for any choice of the points Any 
bounded function whose upper and lower integrals are equal is 
said to be integrable in the sense of Riemann. 

It will be observed that if I = then the difference between 
the sums S and s, 


(Mi - m^) 


must approach zero as n increases indefinitely and the Axi — » 0. 
This criterion enables one to show’' that every continuous function 
is necessarily integrable. For, if f(x) is continuous in the closed 
interval (a, 6), it is uniformly continuous there. Hence, the 
interval (a, 5) can be divided into a finite number of subintervals 
Axi such that for any pair of values of x (say Xi and ^^ 2 ) in the 
subinterval Axi 


Thus, 


— f(x2)\ \Mi — mi\ < €. 

n 

(Mi — mi) AXi < '^eAxi = €(& — a). 


Since eQ) — a) can be made arbitrarily small, any continuous 
function of x is integrable. 

It is not difficult to see that any function which is continuous 
except for a finite number of ordinary discontinuities is integrable 
also. The points of discontinuity can be enclosed in a finite 
number of intervals, each of which is arbitrarily small, and it 
follows from the discussion just above (and from the fact that 
the number of intervals enclosing the points of discontinuity 
is finite) that 


can be made arbitrarily small. 

Jif(x) is integrable then \f(x) \ is integrable, since, for any given 
mode of subdivision, the difference 8 — s for \f(x)\ is less than 
or equal to the corresponding difference 8 — s for f(x). More- 
over, if fi(x) ^ f 2 (x)j and if both fi and /2 are integrable in (a, b), 
then 

> dx, 


if b > a. 
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Note that the difference 

<p(^) = M^) - Mx) ^ 0 , 

and that <p(x) is integrable since both/i(a:) and/ 2 (a;) are. Then 

f’’p(x) dx > 0. 

Ja 

Thus 

dx — dx > 0 , 

which proves the assertion. 

It may be remarked, in conclusion, that more general defini- 
tions of the integral have been given by Lebesgue, Stieltjes, 
Denjoy, and others. The object of all these definitions is to 
include a wider range of functions than those integrable in the 
sense of Riemann. One characteristic feature of all these 
definitions is that if a function satisfies the limitations imposed 
upon it in the treatment of Riemann, then the other integrals 
lead to the same value as the integral of Riemann. 

Since only Riemannian integrals are used in this book, the 
term integrable function will be used henceforth to function 
integrable in the sense of Riemann. It should be observed that 
the integrable function, as defined above, is necessarily bounded. 
Some writers include in the class of integrable functions those 
unbounded functions whose improper integrals exist. The 
subject of Improper Integrals is treated in Chap. X. 

36. Direct Evaluation of Integrals. The definition of the 
Riemann integral of f{x) can be applied to calculate the value 
of the integral of any integrable function, but it will be seen from 
the examples given below that the problem of evaluating an 
integral directly from the definition is likely to be quite vexing. 
In fact, one rarely uses mathematical definitions for purposes 
of calculation,* and a powerful theorem known as the funda- 
mental theorem of the integral calculus (established in Sec. 38) 
enables one to calculate easily the integrals of a large number 
of continuous functions. However, the concept of the definite* 
integral as the limit of the sum is so important that it seems 

* The reader will recall that he seldom uses the definition of the derivative 
in calculating the derivatives of specific functions. Instead, he develops a 
set of formulas based on the definition. 
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desirable to apply the definition to the calculation of the integrals 
of some simple functions before the fundamental theorem is 
discussed. The reason for dignifying this theorem with the 
adjective fundamental will be apparent when the same problems 
are solved vdth its aid. 



Consider the function 

f{x) — where 0 < a; < 1. 

Since is continuous, one is assured that the limit of the sum 
.Xi exists and is independent of the choice of th.e and 


of the mode of subdivision of the interval (0, 1) into n parts. 
Thus, to make the problem easier, let the interval (0, 1) be divided 

into n equal parts so that = - (Fig. 24). The points of 

n 

subdivision xq, xij X 2 , ■ • • , Xn-ij Xn are 


1 2 

— X2 = 

^ n 


n — 1 


Xn = 1. 


If the points be chosen as the right end points of the intervals 
AXi = Xi — Xi^ij there results 
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12 + 22 + 32 

= lim 


+ m? 


Now the sum of the terms in the numerator is given by the 
formula* 


12 + 22 + 32 


n(n + l)(2n 



Substituting this in the right-hand member of the foregoing 
expression gives 



a;2 dx = lim 

n— > 00 


n{n 4- l)(2?^ + 1) 


= 1 

3* 

The reader will find it instructive to carry out the calculation 
in this example by choosing AXi = - and = (i — 0») Axi, 

71/ 

where 0 ^ 1, (i = 1, 2, * • • , n). The di need not be 

equal. Of course, the limit should be the same for an arbitrary 
choice of the points 

Another example of a direct calculation of the integral may 
prove instructive. Let it be required to evaluate the integral 

fo^ dx. 

If the interval (0, x) is divided into n equal parts, so that 

Xt = Xi — Xi-i = - = hj 

n 

* The reader will have no difficulty in proving this assertion by mathe- 
matical induction. 
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Calculating the sum of the n terms of the geometrical progression 
appearing in the bracket gives 



= {e - 1 ) • 


h 


e* - l’ 



lim ■ - V = 1 


gives 



e® — 1. 


PROBLEM 


Evaluate directly from the definition 



37. Mean-value Theorems for Integrals. 

Theorem 1 (First Mean-value Theorem for Integrals). Let 

/(x) and (p{x) be two functions which are continuous in the interval 
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(a, 6) and suppose that <p{x) does not change sign in this interval. 
Then there exists at least one value where a < ^ S h, such that 


In order to prove this theorem, consider 
J\m - fix)]<p(x) dx, 

in which M stands for the maximum value of f(x) in (a, 6). 
Let it be supposed that <p(x) > 0; then, since M > f{x), it follows 
that* 

J\m - S{x)Mx) dx ^ 0, 

or that 

(37-1) '<p(x) dx > jy(x)(p{x) dx. 

Similarly, if m represents the minimum value of f{x) in (a, 6), 
it is seen that 

(37-2) jy(x)<p(x) dx > mj^^p(x) dx. 

It follows from (37-1) and (37-2) that 

jy(x)<p(x) dx ~ iJiJ\{x) dxj 

in which m < ix < M. But f(x) is continuous and hence there 
exists some value f between a and 5, for which /(Q = ju. There- 
fore 

(37-3) TfixMx) dx = mT<pix) dx. 

In case <p(x) == 1, (37-3) reduces to 

Tfix) dx = /($)(6 - a), 

a form which is already familiar from elementary calculus. 

This first mean-value theorem expresses the integral in terms of 
the value of one of the functions at a point intermediate between 


* If ip{x) ^ 0, it is merely necessary to reverse the inequalities. 
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a and b. Another mean-value theorem for integrals uses the 
intermediate value in the limits. This second theorem requires 
the definition of functions which are monotone increasing or 
monotone decreasing. A junction (p{x) is said to he monotone 
increasing in the interval (a, 6), if <p(x 2 ) ^ ^(xi) for X 2 > Xi, for 
all values of Xi and x^ in (a, b). It is said to be monotone decreas- 
i'^j if ^2 > Xi, for all values of Xi and x^ in (a, 6). 

Theorem 2 (Second Mean-value Theorem for Integrals). Let 
f{x) and <p{x) be two functions which are continuous in (a, 6). 
If ip(x) is a 'positive monotone-decreasing function, then there exists 
a value where a < ^ < b, such that 

dx = dx. 

If (p(x) is a positive monotone-increasing function in {a, h), then 
there exists a value where a < ^ < b, such that 

£f(x)<p(x) dx = (pil)£f(x) dx. 

If <p(x) is either monotone increasing or monotone decreasing but not 
necessarily always positive, then 

^ dx + <pQ))J^f{x) dx. 

The proof of the first part of the theorem depends upon the 
fact that 

Pf(x)(p(x) dx = lim 

n—^ oe 

4 = 1 

in which the interval {a, h) has been divided into n parts by the 
points Xi in such a way that 

a = Xo < Xi < X2 * • * < X-n-l < Xn^h, . 

Now consider the expressions 

= 1, 2, • ‘ , n, 

and let'ikf represent the largest and m represent the smallest of 
these expressions. Then, since 

Si 


and 


2 , 
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it follows that 


n — l 

(37-4) 

But (p(x) is a positive monotone-decreasing function, so that each 
expression is nonnegative, as is Hence the 

right-hand member of (37-4) is not less than 

n — l 


and it is not greater than 

n—l 


Therefore, 


As n is increased so that each of the differences Xi — 
approaches zero, approaches a. Moreover, since m and ikf are 
the smallest and greatest of the expressions 

2 

it is seen that, as n is increased, m and M approach, respectively, 
the minimum and maximum values m and ikf of dx, where 

Tj takes all values from a to b. Hence, 

C<p(x)f{x) dx < M<p{a) 

Ja 

and 


in which m < ji < M, But f{x) is continuous and therefore* 
* See Sec. 38. 
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there must be some value | for which ix = dx. It follows 

that 

(37-5) J^<p(x)f(x) dx = dx, a < ^ < b. 

Similarly, if <p(x) is a positive monotone-increasing function, 
it can be shown that 

(37-6) J\(x)f(x) dx = <p(b)J^f(x) dx, a < ^ < b. 

For the third part of the proof, suppose that (p{x) is a mono- 
tone-increasing function. Then define ^(x) by 


so that $(a:) is a positive monotone-decreasing function in (a, b). 
Hence, 

j‘y{x)^{x) dx = $( 

= [(pQ,) - <p{a)] dx. 


But 


dx 

= <pQ))jy{x) dx — jy{x)(p{x) dx. 

Hence, 

- ‘p(P)£f(x) dx - <p{b)jy(x) dx + ^(a)jy(x) dx, 
or 

jy(x)(p{x) dx = <p{b)J‘^f{x) dx -h (p{a)jy(x) dx. 

The same result can be obtained in the case where <p{x) is a 
monotone-decreasing function by the use of the auxiliary function 

^(x) = <p(x) - <pQ}). 

As an example of the application of the first mean-value 
theorem for integrals, consider the problem of establishing the 
bounds for the elliptic integral 


dx 


where < 1. 
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It follows from the foregoing that 

dx 1 , 

Jo \/(l - ^-)(1 - Vi - Vl - 

where 0 ^ ^ But 



Hence, 

& _ 'TT 1 

jo V(i - if’-)(i - hv) 6 vr=w^’ 

Replacing J by zero and one-half gives a lower and an upper 
bound for the value of the elliptic integral. Thus, 

IT ^ dx < ^ 1 

6 ~ Jo V(1 - ® Vl - 

38. Fundamental Theorem of the Integral Calculus. Consider 
an integrable function f(x) defined in the interval a ^h. 
It is clear that if a: is any point of the interval, then 

fy(x) dx 

J d 

exists, and its magnitude depends on the value assigned to the 
upper limi t- Thus, for a fixed lower limit, the definite integral 
is a function of the upper limit, and it will be designated by F(a:), 
SO that 

Fix) = j[7(a:) dx. 

In order to avoid confusion between the letter x denoting the 
variable of integration and the same letter used to denote the 
upper limit, the integral will be written as 

Fix) = j^7(0 dt. 

Let X -^h he some point of the interval (a, b), then 
Fix + h)= dt, 
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and 

Fix + h)- Fix) = dt - fjm dt 


Combining the integrals in the right-hand member of this expres- 
sion gives 

(38-1) Fix + A) - Fix) = dt. 

An important deduction can be drawn immediately from (38-1). 
Since 

lim dt = 0, 

it follows that 


= 0 


so that F{x) is a continuous function whenever f{x) is an integrdble 
function. Furthermore, if f{x) is a continuous function in the 
closed interval (a, 6), then the application to (38-1) of the first 
mean-value theorem for integrals gives 

F{x ^F{x)^m)h, 

where $ lies between x and a: + A. 

Then 


(38-2) — 

dx h—^o h 


= lim /(I) = fix). 

h-^0 


Now any function F(x) whose derivative is equal to f(x) is 
called a 'primitive of fix), or an indefinite integral of f{x). Thus 
the statement embodied in (38-2) gives an important theorem. 

Theorem. The definite integral, regarded as a function of the 
upper limit, is a primitive of the integrand whenever the latter is a 
continuous function. 

If G{x) is any primitive of f(x), then it differs from F{x) at 
most by a constant, since the derivatives of Gix) and F(x) are 
equal.* 

* See Sec. 20, p. 53. 
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Thus 

Gix) = F{x) + C, 
or 

G{x) = J[7(^) dx + C. 

Setting the upper limit of the integral equal to a gives 

G{a) = C, 


since dx = 0. 

Consequently, 

(38-3) ^ 


where G(x) is any primitive. 

Equation (38-3) is the symbolic statement of the following 
theorem: 

Fundamental Theorem of Integral Calculus. If f(x) is con- 
tinuous in the interval a ^ x < h and G{x) is a function such 


dG 

that ^ — f{x) for all values of x in this interval , then 


J^V(^) dx = (?(&) — G(a), 

In the first example of Sec, 36 it was shown directly from 
the definition of the definite integral as the limit of the sum that 

x^ 

Since a primitive of x^ is it follows from the fundamental 
theorem that 


Again 


x‘^dx 




1 

3' 


which agrees with the result obtained in Sec. 36 by a different 
method. 
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The symbol Jfix) dx is used to denote an indefinite integral 

of f{x). The reader will deduce the following properties of 
indefinite integrals: 

(a) d J f{x) dx = f{x) dx-, 

dx = c Jfix) dx, where c is a constant; 

(c) f Uiix) + f 2 ix)] dx = J fiix) dx + Jfiix) dx. 

39. Differentiation under the Integral Sign. Consider the 
definite integral 

(39-1) t, a) dx, 

in which the integrand is a function of a parameter a (as well as 
of x) and the limits are also functions of a. This integral is a 
function of a, and not of the variable of integration x. It 
is frequently desired to obtain the derivative of (39-1) with 
respect to a in cases in which it is inconvenient or impossible to 
express the indefinite integral in explicit form. For this reason 
the following theorem is of great value. 

Theorem. Let 



where mq and Ui are differentiable functions in a closed interval (ao, 
«i)/ /(^) «) faix, a) are continuous in the region ao < a ^ o-i, 
Mo (a) X ^ Uf(a). Then 

d(p 

da 

In order to prove this theorem, first form 
L(p = <pia Aa) — <pioi). 

Then 


d,x 
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The first integral of the first expression has been written as the 
snTrt of the first three integrals of the second, expression. If the 
second and fourth integrals are combined, one can write 

a + A«) -/(a;, Ag) 

Ag juoM Ag J uaM Ag 

By the mean-value theorem of the differential calculus* 
f(x, a + ^a) - fix, g) = Aa-faix, v), a < r] < a + Aa. 
Also, by the first mean-value theorem for integrals, 
g + M ^ /do, g + Ag) ^ 


where Uoict) ^ ^ wo(g -t- Ag); and, similarly. 


g + Ag) 


dx = /(|i, g - 


where «i(g) ^ |i ^ Wi(« + Ag). 

Therefore, 

^ ^ J ^ ^ ^ ^ ^ 

Ao: ‘ "" 

with 

a < 7? < a + Aa, 'i^o(o') < |o ^ Wo(a + Aa), 

Ui(a) :< ^ 'Wi(a + Aa). 

Hence 

^dx-/(uo,a)' .,«)^- 

In case the limits 1 ^ 0 ( 0 :) and tii(a) are constants, say xo and 
(39-2) reduces to 


See Sec. 20. 
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Example 1. Formula (39-3) is frequently used for evaluating 
definite integrals.* Thus, if 

<p{cc) = log (1 -f a cos a:) dx, 

then 


cos 


^1 - 1 + a cos 


= + 

a\ VI - ay a aVl - a* 

Therefore, 

(a) = IT ff- - 2.. . ..A da 

J v« aVl - aV 

= ^(log a + log + 


(a) = T log (1 -I- Vl - aO + C. 


But, when a = 0, 

= 0. 

Hence, 


0 = T log 2 + c 

and c = — x log 2, 

and 

vr 


2 

Example 2. Find ~j if 

aoL 

r2a a;! 

e dx. 

J -a2 

Then 



dcp 


J -«2 a® 

* See also Sec. 97. 


2ae-““ 
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PROBLEMS 

1. Find if <p{a) — I (1 — or cos xY dx. 

da Jo 

2. Find if ^(qj) = ( tan”^ dx, 

da Jo ^ 

3. Find if <p(a) = | tan {x — a) dx. 

da Jo 

X- 

6. Differentiate under the sign and thus evaluate 

What is the permissible range of values of a? 

6, Differentiate under the sign and thus evaluate 


Find if ^ 




— cos by using — cos a;) = 7r(a^ — 1) > 1. 

7. Show that 


(1 — 2a cos X + a^) dx = 0, 

= TT log a^j 


if ^ 1, 
if a^ ^ 1. 


8. Verify that 




sin hix — a) da 


is a solution of the differential equation 


where A; is a constant. 


40. Change of Variable. In performing the evaluation of the 
definite integral with the aid of the fundamental theorem, it is 
frequently desirable to change the variable of integration in the 


integral by means of some relation x = <p{t). 


In order to 


emphasize the need of caution, observe the following example of a 
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purely formal change of variable which leads to a nonsensical 
result. 

The integral 



Now, let it be supposed that the variable x is replaced by another 
variable t connected with x by means of the relation 

i = 

The limit in the resulting integral, corresponding to a; = —1, is 


and the upper limit becomes 

t = (ly- = 1 . 

Thus, in the transformed integral the upper and lower limits are 
each equal to unity, so that the value of the transformed integral 
appears to be zero. The difficulty here lies in the fact that the 
function x = tp{t) is not a single-valued function. 

Theorem. Letf(x) be a continuous and single-valued function of 
X in the closed interval (a, b) and let x = <p(t) be a continuous, 
single-valued function of t possessing a continuous derivative in 
the closed interval (a, ^), where ip{oi) = a and = b. Then 

dx = jy[<p{t)]p'{t) dt. 

In order to prove this theorem, consider the integrals 

(40-1) F(x) = ^(0 == dt 

By hypothesis x = <p(t), so that F(x) is a function of t whose 
derivative with respect to t is 

dF(x) __ dF(x) dx 
dt dx dt 

dF(x) 

But ^ = f{x)f since /(a;) is continuous, so that 

jjy 

= fi<p(t)W{t), where <p'{ 
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On the other hand, the derivative of is 


since the integrand of is continuous.* 

The derivatives of F and ^ with respect to t being equal, the 
functions F and can differ only by a constant. But for ^ =5 a, 
X = (p{a) = a, so that 

F{x)t^a = 0 . 

Moreover, 

= 0 . 

Thus the functions F{x) and ^{t) are equal for ^ = a, and conse- 
quently, they are equal for all values of t in the interval (a:, j8). 
Setting t = j3 in the second of the integrals (40-1) and 

X = (p(^) = h 

in the first integral gives the desired result 


Example, Consider dx. If a; = sin t, then 

dx = cos t dt. 

When a; = 0, ^ = 0 and when a; = 1, ^ so that 


x^ dx ^ — sin^ t cos 


£ 


cos^ t dt = ^ 
4 


PROBLEM 


Justify the substitution dx = <p'{t) dt in the indefinite integral 
//w dx to obtain the indefinite integral dt 


41. Applications of Definite Integrals. The reader is familiar 
with the derivation of the formulas for areas bounded by curves, 
* See Theorems 1 and 2, Sec. 12. 
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for volumes and surfaces of revolution, and for the length of arc 
of a curve. These formulas are given below for reference, and 
in the light of the meaning of the definite integral stated in Sec. 
35, it is best to regard them as the definitions of the geometrical 
entities under consideration. 

The outline of the procedure employed in defining the length 
of arc of a curve is as follows. Assume that the equation of a 
continuous curve C is given in a parametric form as 

(41-1) ^ “'52 ^ ^ 

[y = <p 2 {t), a ^ t Sb. 

Let it be required to find the length of arc of C between the points 
corresponding to the values of the parameter t = a and t = b. 
Divide the interval a < t < b into n subintervals of lengths 
Ail, Ai 2 , • • • , Ai„ by inserting n — 1 points of subdivision 
chosen so that 

a = to < ti < t 2 •• • 

Denote the increments of the functions in (41-1), corresponding 
to Ail, Ai 2 , • • • , Aim by Aa^i, Ax 2 , * * * , Axn, and Ayi, Ay^, 

* ‘ * j Ayn» 

The sum of the lengths of the chords ACi joining the consecutive 
points on the curve C which correspond to the values of the 
parameter i = i^, (i =■ 1, 2, • • * , n), is 

n 

Sn = ^ 
i = l 

where 

ACi = V {AxiY + {AyiY, 

If the limit of the sum Sn exists* as the number of subdivisions 
is increased indefinitely in such a way that each AU 0, then 
this limit is called the length of arc of the curve between the 
points corresponding to the values of the parameter t == a 
and i = fe. 

To ensure the existence of this limit, it is not sufficient to 
require merely that (piit) and <po{t) be continuous. It is sufficient, 
however, to assume the continuity of the derivatives of 


' Of course, this limit must be independent of the mode of subdivision. 
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and in the interval (a, h). In this event the length s of 
the curve is given by the formula 

-r-/( 

The volume of the solid of revolution which is generated by 
revolving a continuous curve y = f(x) about the rr-axis, and 
which is bounded by the planes x = xi and x = X 2 can be calcu- 
lated from 

r\y‘^dx, 

Jxi 

The surface of revolution of the same solid is 

In the case of the surface of revolution it is sufficient to demand 
the continuity of the derivative of 2 / = so that the integrand 
will be a continuous function. 

Example 1. Consider the problem of determining the length 
of arc of the logarithmic spiral whose equation is 

p = 

The element of arc length in polar coordinates is given by 
ds = \/ (dpy + (p doy, 

so that 


5 = + ldd 

n 


Example 2. Find the length of the lemniscate p^ = cos 2Q. 
Now p = a\/ cos 2^, and therefore, 


dp 

Te 


a sin 2B 
A /cos 2Q 
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I cos 


+ cos 20 do 


= 4a r 

Jo vcos 26 

Setting 26 = X gives 

X Vcos a; 

and the substitution of cos <p = -s / cos x gives 


dx 




d(p 

\/l M <P 

This integral cannot be evaluated in a closed form with the 
aid of the elementary functions. It is the standard form of the 
elliptic integral of the first kind, which can be evaluated either 
in infinite series (see Sec. 86) or with the aid of the tables of 
elhptic integrals. 


PROBLEMS 

1. Find the area bounded by the curve 


2. Find the volume generated by revolving the curve 
about the rr-axis. 

3. Find the surface of the solid whose volume is required in Prob. 2. 

4. Find the surface of the ellipsoid of revolution 

^ 2 

Ans. S sin~^ e + 2'irac\/l — e% if c > a; 



where e is the eccentricity. 

6, Find the surface generated by revolving the cardioid 
p = 2a cos^ ^ 


jins. 


about the polar axis. 



CHAPTER V 
MULTIPLE INTEGRALS 

42. Double Integrals. The definition of the double integral 
is entirely analogous to that given earlier for the simple integral. 

Let f{x, y) be a single-valued bounded function in a closed 
region E (Fig. 26) . Let the region R be subdivided in any manner 
into n subregions ARi, AR 2 , • • • , Aif„ of areas AAi, AA 2 , • • • , 



Ai„. The upper and lower bounds of the function j{x, y) in the 
subregion ARi will be denoted by Mi and mi, respectively. 
Then 

mi AAi < fi^i, rji) AAi < Mi Aii, 

where (Ji, m) is any point in the region ARi. Let s„ and Sn denote 
the sums 


Sn = and Sn = 

which clearly depend on the number n of subregions and on the 
mode of subdividing the region R into parts. 

If the sums s» and Sn approach the same limit S when the 
number of subregions is increased indefinitely in such a way that 
each AAi 0, then the limit of the sum 
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vnll also be S, since 


U- < 

for any mode of subdivision and for any choice of the points 
Vi)- This common limit S is defined as the double integral 
of /(rr, y) over the region R, and one writes 

(42-1) lim li = 

The region R is called the region of integration and corresponds 
to the interval of integration (a, h) in the case of the simple 
integral. The term double integral refers to the dimensionality 
of the region R. 

The existence of the unique limit S is guaranteed if one 
assumes that the function f{x, y) is continuous in the closed 
region R. This is obvious from the geometrical considerations 
of Sec. 44 if one assumes that the function z = fix, y) is repre- 
sented by a surface. The analytical proof makes use of the 
property of the uniform continuity of continuous functions 
fix, y) defined over a closed region R and is not given here.* 

PROBLEM 

Let M and m be the maximum and the minimum values, respectively, 
of the continuous single- valued function /(a;, y) defined over a region E; 
then 


Show, from a consideration of tliis inequality, that 
ffix, y) dA = /(J, ■ri)A, 

where (|, y) is some point of the region R, whose area is A. This is 
the mean-value theorem for double integrals. 

43. Evaluation of the Double Integral. It will be assumed in 
this section that the function f{x, y) is continuous over a closed 
region B, so that the limit of the sum (42-1) will be independent 
* See the analogous discussion in Sec. 35. 
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of the mode of dividing the region R into the subregions ARi 
and also of the choice of the point rii) within the subregion 
ARi. 

The definition given in the preceding section gives no con- 
venient means for the evaluation of double integrals. In order 
to evaluate the double integral, it will be simpler to consider first 



the case in which the region R (Fig. 27) is a rectangle bounded 
by the lines x — a, x = b, y = c, y = d. The extension to 
other types of regions will be indicated later. Subdivide R 
into mn rectangles by drawing the lines x ^ xi^ x = X 2 , • * * , 
X = Xn^i, y y = y2, ' • • , y ym,-i. Define 


where xo = a and Xn = 6, and define 


where yo = c and ym = d. Let ARij be the rectangle bounded by 
the lines x = Xi^i, x = Xi, y = y = 2/?* Denote the area of 
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the rectangle which stands in the ith column and the jth 
row, by 

AAij = Axi Ayj 

and form the sum of the expressions 

/(&'? Vij) AAijj 

where (?ij, is any point of ARij. This sum is 

n, j = m 

(43-1) ^ /(fej Vij) ^Vh 


where the summation symbol signifies that the terms 

appearing under the summation sign can be added in any 
manner w^hatsoever. 

Suppose that the terms of (43-1) are arranged so that the 
rectangles ARn are used first; then all the rectangles ABi^) 
then all the rectangles ARiz] etc. This is equivalent to taking 
the sum of the terms corresponding to the first, second, third, 
etc., rows of rectangles and then adding these sums. Such a 
rearrangement of the terms of the sum permits one to write 
(43-1) as the double sum 

(43-2) 

where the expression in the bracket represents the sum of the 
terms corresponding to any fixed value of j. From the definition 
of the ordinary definite integral, the expression appearing in the 
bracket approaches a limit when n oo in such a way that each 
Axi 0. Hence, one can write 

lim (x, dXy 


or 

(43-3) m) dx + €j*, 


where lim €j = 0. The latter expression results from the 
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definition of the limit, and it merely states that for a sufficiently 
large n the difference between the sum and the integral can be 
made as small as desired. 

Now the integral 

jjix, vi) dx 

contains r\j as a parameter and hence defines a function of yjj, 
say 

(43-4) <p(m) = £f(^, Vj) dx. 

Substituting from (43-3) in (43-2) and making use of (43-4) gives 


m n 


(43-5) 

But 


so that 




lim 

m-4 00 


%*) AiTiJ Ayj\(p(^ 

Ayi = dy 


7/i 

At/j* = <p{y) dy -f e, 


3=1 


where lim e = 0. Thus (43-5) becomes 


y = i 

Calculating the limit as both m and n tend to infinity gives* 

m 

* The reason for the vanishing of lim A?// is not entirely obvious. 

m-^ 00 
n— > ao j ~ ^ 

Even though €/— > 0 when n-^ oo^ the index m likewise tends to infinity, 
and it is conceivable that the limit of the sum may be different from zero. 
The fact that this is not the case here can be seen from the following con- 

J ^Xi 

f(x, 7}j) dx denote the integral of the function f{x, 

Xi-l 

over the interval Axi. Then 

f{X) T}j) dx Vii) TTLij 

l ' ' 


and niij stand for the maximum c 
p, T]j) in the interval (Xi^i, Xi). But 


the 
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lim 


{x, y) dx^ dy, 

where the second step is obtained by recalling the definition 
(43-4). The left-hand member of this equation gives the double 

integral y) dA, so that 

The double integral is, therefore, evaluated by considering 
f{x^ y) as a function of x alone but containing y sls Si parameter, 


dx = 


Hence, 


lx ~ Axi. 

Let e' be the largest of the numbers \Mij - miji (i = 1, 2, • • • n) 
(i = 1, 2, • • • , m), then ’ 


Cl = e'ih — a). 


Thus 


dx — 


< e'{b - a). 


But, from (43-3), the left-hand member of this expression is precisely the 
numerical value of e,-, that is, 


Hence, 


e'{b - a). 


e'{b - a) 


€'(6 - a)(c - d). 


Since /(x, y) is a continuous function, the difference between the maximum 
and the minimum values of the function in any subregion AiSt,- tends to zero 
as the number of subregions is increased indefinitely, and consequently^ 
e' 
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and integrating it between x = a and x = b and then integrating 
the resulting function of y between y = c and y = d. The right- 
hand member of (43-6) is known as an iterated integral^ and 
(43-6) establishes the relation between the double integral over 
the rectangle R and an iterated integral over the same rectangle. 

Similarly, by taking the sum of the terms in each column and 

then adding these sums, there results 

(43-7) jj{x,y)dA 

= y) dy dx. 

In case (43-7) is used, f{x^ y) is first 
considered as a function of y alone 
and integrated between y = c and 
^ y — d, and then the resulting func- 
tion of X is integrated between x = a 
and X — h. Either (43-6) or (43-7) can be used, but one of them 
is frequently simpler in the case of a particular function /(a;, y). 

Suppose R is not a rectangle but is a region bounded by a 
closed curve C (Fig. 28) which is cut by any line parallel to either 
axis in at most two points. Let Bi and B 2 be the points of C 
having the minimum and maximum ordinates, and let Ai and A 2 
be the points of C having the minimum and maximum abscissas. 
Let X == <pi{y) be the equation of B 1 A 1 B 2 , and x = ^ 2 ( 2 /) be the 
equation of B 1 A 2 B 2 . Then, in taking the sum of the terms by 
rows and adding these sums, the limits for the first integration 
will be (pi(y) and ^ 2 ( 2 /), instead of the constants a and b. The 
limits for the second integration will be /3i and ^ 2 , in which 
is the y-coordinate of Bi and ^2 is the ^/-coordinate of £ 2 . Then 
(43-6) is replaced by 

(43-8) [Xj y) dA = (a;, y) dx ( 

Similarly, if y — fi(x) is the equation of AiBiA 2 y y = / 2 (a;) is 
the equation of A 1 B 2 A 2 , ai is the abscissa of Ai, and 0:2 is the 
abscissa of A 2 , (43-7) is replaced by 

(43-9) 

In ease 5 is a region bounded by a closed curve C which is cut 
in more than two points by some parallel to one of the axes, the 
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pre\ious results can be applied to subregions of E whose bounda- 
ries satisfy the previous conditions. By adding algebraically 
the integrals over these subregions, the double integral over E 
is obtained (Fig. 29). 


y 

y=b 

L 

Fig. 29. Fig. 30. 

Example 1. Compute the value of /i = \ y dA where R 

jn 

is the region in the first quadrant bounded by the ellipse 

= l (Fig. 30). 

Using (43-8) and summing first by rows, one finds 



Using (43-9) yields 

ydydx=^ pfe 
0 Jo Jo 

It may be remarked that the value of Ji is equal to yAj where 
y is the ^/-coordinate of the center of gravity of this quadrant of 

the ellipse, and A is its area. Since A = 


dx 

0 3 
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d^Jy 

Similarly, by evaluating h = \x dA = 

- — h — ^ 

^ A irab 3t 

■4" 

which is the s-coordinate of the center of gravity. 

Example 2. Moment of Inertia. It will be recalled that the 
moment of inertia of a particle about an axis is the product of its 
mass by the square of its distance from the axis. If it is desired 
to find the moment of inertia of a plane region about an axis 

perpendicular to the plane of the region, 
the method of Sec. 43 can be applied, 
where f{x, y) is the square of the dis- 
tance from the point {x, y) of the region 
to the axis. Then 

M= fr^ dA. 

Jr 

X 

For example, let it be required to 
find the moment of inertia of the area in 
the first quadrant (Fig. 31), bounded by the parabola y^ = 1 ~ z 
and the coordinate axes, about an axis perpendicular to the zy- 
plane at (1, 0). The distance from any point P(x, y) to (1, 0) 
is r = ^(a; — 1)^ -f 2/^. Therefore, 

M = fj(z - ly + y^] dA. 

Evaluating this integral by means of (43-8), there results 
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44. Geometric Interpretation of the Double Integral. If 

f{x, y) is a continuous and single-valued function defined 
over the region R (Fig. 32) of the a;2/-plane, then 2; = f{x, y) 
is the equation of a surface. Let C be the closed curve 
that is the boundary of R. Using R a,s 2 l base, construct 
a cylinder having its elements parallel to the ^-axis. This 
cyhnder intersects z = /(re, y) in a curve T, whose projection 



on the xy-pla^ne is C. Denote by S the portion of ^ = f(x, y) 
that is enclosed by F. Let R be subdivided as in Sec. 43 by the 
lines a; = rei, (i = 1, 2, • • • , n — 1), and y = y^, (j == 1, 2, • • • , 
m — 1), Through each line x = Xi pass a plane parallel 
to the yz-'plsbue-; and through each line y = yj pass a plane 
parallel to the rc2;-plane. The rectangle whose area is 

AAi/ = Axi Ayj, will be the base of a rectangular prism of height 
/(&;j whose volume is approximately equal to the volume 
enclosed between the surface and the rrtz-plane by the planes 
X = Xi^ij X = Xi, y = 2/3-1 and y = t/j. Then the sum 

(44-1) 

gives an approximate value for the volume V of the portion of 
the cylinder enclosed between z = /(re, y) and the rc2/-plane. As 
n cx) and m — > 00, the sum (44-1) approaches V, so that 

r = //(a:, y) dA. 


(44-2) 
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The integral in (44-2) can be evaluated by (43-8) in which the 
prisms are added first in the x-direction, or by (43-9) in which 
the prisms are added first in the y-direction. 

It should be noted that formulas (43-8) and (43-9) give the 
magnitude of the area of the region R if the function /(x, y) = 1; 
for the left-hand member becomes 

which is -4. The area A can be evaluated by using 



Fig. 33. 


Example. Find the volume of the tetrahedron bounded by 

X 7J 

the plane ^ ^ ^ ~ ^ coordinate planes (Fig. 33). 

Here 


z = 


If the prisms are summed first in the a;-direction, they will be 
summed from a: = 0 to the line abj whose equation is 


Therefore, 
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ahc 

T' 


This result was obtained by using (43-8) for the evaluation of V, 
"but (43-9) could be used equally well. 

PROBLEMS 

1. Evaluate 



and describe the regions of integration in (a) and (h). 

2. Verify that dy dx — + 2/“) dx dy, where the 

region E is a triangle formed by the lines y = 0, y = x, and x = 1, 

3. Evaluate and describe the regions of integration for 


fo^fa-r 

^2/ dx; 

(d) + a;2 + 2 / 2 ) dy dx; 

w n: xy dx dy. 


4. Find the areas enclosed by the following pairs of curves: 

(a) y = X, y x^; 

(b) y = 2- x,y^ = 2(2 - x); 

(c) y = 4 — x^, y = 4: — 2x; 
id) y^ = 5 — X, y = X + 1; 

(e) y = -y / — x^, y = a — x. 


6. Find by double integration the volume of one of the wedges cut off 
from the cylinder x^ + y^ = a?- by the planes s = 0 and z = x. 
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6. Find the volume of the solid bounded by the paraboloid 
1^2 ^ 2 “ = 4x and the plane x = 5. 

7. Find the volume of the solid bounded by the plane z = 0, the 
surface 2 = a;- + 2/- 4” 2, and the cylinder x- -h y- = 4. 

8. Find the smaller of the areas bounded by y — 2 — x and 

a*- + = 4. 

9. Find the volume bounded by the cylinders y = x^, y- = x, and 
the planes 2 = 0 and 2 = 1. 

10. Find the volume of the solid bounded by the cylinders 

X- + = or‘ and y"^ 

11. Find the coordinates of the center of gravity of the area enclosed 
by 2 / = 4 ” a;- and y — 4: — 2x. 

12. Find the moments of inertia about the x- and y-sixes of the 
smaller of the areas enclosed hyy = a x and y^^ = or, 

45. Triple Integrals. The triple integral is defined in a manner 
entirely analogous to the definition of the double integral. 
The function 

V, 2 ) 

is to be continuous and single-valued over the region of space It 
enclosed by the surface S. Let R be subdivided into sub- 
regions Afit/i. If tWiih is the volume of the triple integral 
of /(rr, y, z) over R is defined by 

(45-1) lim 

in a way entirely analogous to that given in Sec. 43. 

In order to evaluate the triple integral, R is considered to be 
subdivided by planes parallel to the three coordinate planes and 
the case of the rectangular parallelepiped is treated first. In this 
case 

NVijjc = AXx Ay,* Azk, 

By suitably arranging the terms of the sum 


Muk, nuk, Uik) Ao^i Ay,* NZkj 
= 1 

it can be shown, as in Sec. 43, that 

^ 

By other arrangements of the terms of the sum, the triple integral 
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can be expressed by means of iterated integrals in which the 
order of integration is any permutation of that given in (45-2). 

If B is not a rectangular parallelepiped, the triple integral 
over R will be evaluated by iterated integrals in which the limits 
for the first two integrations will be functions instead of con- 
stants. By extending the method of Sec. 43, it is readily shown 
that 

(45-3) y, z) dV = ^f{x, y, z) dx dy dz. 


Similarly the triple integral can be evaluated by interchanging 
the order of integration in the iterated integral and suitably 
choosing the limits. 

The expression (45-3), or the similar expressions obtained by a 
different choice of the order of integration, gives the formula 
for the volume of R in case/(x, y, z) = 1. Therefore, 





In order to clarify the method of evaluating a triple integral 
by means of iterated integrals, consider the calculation of the 
integral of the function /(a;, y, z) over a region 72, which is bounded 
by a closed surface S. Let y, z) = 0 be the equation of S 
and denote by F the volume enclosed by (Fig, 34). The 
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surface S will be assumed to be such that a straight line parallel 
to one of the coordinate axes, say 2 , cuts S in not more than two 
points. All extension to more complicated surfaces can be 
made immediately in a maimer analogous to that indicated in 
Sec. 43 for double integrals. 

Construct the right cylinder which projects the surface S 
on the x^-plane. Let C be the curve along which the projecting 
cylinder is tangent to S, and let the projection of C on the 
xy-plane be the curve C' whose equation is y) = 0. The 
curve C divides the surface S into two parts. Denote the equa- 
tion of the upper part of the surface by 2 = <P 2 {x, y), and that 
of the lower part by z = <pi{x^y)* Next, divide the volume 
V into elementary volume elements AF in the following way. 
Divide the area enclosed by O', by a series of lines parallel to 
the coordinate axes, into a number of elementary areas, of which 
lAf is typical. Using each of the elements AAf as a base, 
erect on each element a prism that will cut S in ASi and AS 2 , 
and dmde the portions of the prisms lying between A;Si and 
ASo by a series of planes parallel to the rc^z-plane. The entire 
volume V is thus divided into elementary volumes AF. The 
element AF,-/ = A^t AA/ is outlined in Fig. 34. 

Now select a point (x, y^ z) vithin each of the volume elements 
AFx/, and form the sum 


{x, y, z) AZi] AAi. 


The limit of this sum as Azi 0 defines the integral 

The quantity within the brackets is a function of x and y, say 
F(rr, y)j and the limit of the sum 

ix, y) 


as AAj 0 is a double integral over the area bounded by C. 
If it is evaluated by the methods of Sec. 43, there results 


y, z) dV = y, 2 ) dz] dy dx. 


* Obviously z = y) and z = y) are the solutions of the equation 
y, 2 ) =0 for z in terms of x and y. 
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A specific illustration may clarify this matter further. Let 
it be required to determine the volume enclosed by the ellipsoid 

- 2)" , {y - 9)2 , (z - 16)2 , 

1 — T~ + — 9 

The equations z = <px{x, y) and s = <p 2 (x, y) are, in this ease, 

s = 16 + — {x - 2)2"^ _ 

the upper sign giving <p 2 and the lower giving <pi. The equation 
of the curve C' is that of the ellipse 

-L (y - 9)^ 

1 4 

so that 

= 9 - 2Vl - (x- 2)2 

and 

= 9 + 2V1 - {x- 2)2. 

The evaluation of the integrals is 
left as an exercise for the reader. 

As another illustration, let it be required to find the moment of 
inertia 7* of the solid bounded by the cylinder x^ y^ = 
and the planes z = 0 and z = b about the a;-axis (Fig, 35). 
Assume uniform density a. The function f(x, y, z) is the square 
of the distance of any point P{x, y, z) from the x-axis. Therefore j 

fix, y, z) = 

Hence, 

h = 



f i(P + 6* — a;2)-v/ a2 — dx 

'5 ,,'0 
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PROBLEMS 


1. Evaluate: 



dy dx; 



dy dx. 


2. Eind by triple integration: 

(a) The volume in the first octant bounded by the coordinate planes 
and the plane x + 2y + Zz = 4. 

(b) The volume of one of the wedges cut ofi from the cylinder 

3 j 2 = q 2 ijy planes z = 0 and z = x. Ans. %a^. 

(c) The volume enclosed by the cylinder + y^ ^ I and the 
planes 2 = 0 and 2 = 2 — x. 

(d) The volume enclosed by the cylinders y^ — z and + 2 /^ = 


and by the plane 2 = 0. 


Ans. 


H U/“ 

T‘ 


(e) The volume enclosed by the cylinders y^ + ‘ and 

y^ = a^. A.ns. 

(/) The volume enclosed by y^ + 22 - = 4a: — 8, 2 /^ + =* 4, and 

a; = 0. Ans. Hr. 

{g) The volume in the first octant bounded by the coordinate 
planes and a: + St/ + 22 = 6. 

{h) The volume enclosed by the cylinder + 2 /^ = 9 and the 
planes z = 5 — x and 2 = 0. 

(i) The volume of the cap cut off from y^ + = 4x by the plane 

2 = 0 ;. 


3. Find the moments of inertia about the coordinate axes of the solids 
in Prob. 2. 

4. Find the coordinates of the center of gravity of each of the volumes 
in Prob. 2. 

5. Find by triple integration the moment of inertia of the volume 
of a hemisphere about a diameter. 

6. Find the coordinates of the center of gravity of the volume of the 
solid in Prob. 5. 

7. Find by triple integration the moment of inertia of the volume of 
the cone y^ + z^ — a^x^ about its axis. 
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8. Find the moment of inertia of the cone in Prob. 7 about a diameter 
of its base. 

9. Find the volume in the first octant bounded hj z = x + I, x = 0, 

y = 0, X = 2z, and = 4. 

10. Find the coordinates of the center of gravity of the volume 

bounded by z = 2{2 — x — y), z = 0, and z = 4 — — y^. 

46. Change of Variables in a Double Integral. Let the vari- 
ables X and y be connected with some other variables u and v 
by means of the relations 

(46-1) 

where the functions entering in (46-1) are continuous and 
possess continuous first partial derivatives with respect to x 
and y in some region of the a;z/-plane. Moreover, assume that 



the equations (46-1) can be solved for x and y in terms of v, 
and V to yield 

(46-2) I* "" 

{.y = v). 

If u and V are assigned some fixed values, say Wo and the 
equations 

^0 = fi{x, y), 

== y), 

determine two curves which will intersect in a point {x^y yo), 
such that 


Xo = 
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Thus the pair of numbers (woj t’o) determines the point (xq^ ^o), 
in the x-^-plane (Fig. 36). 

If u and V are assigned a sequence of constant values 

(Ul, I’l), (ih. V^), (W-S, i’s), • * * , (Unj Vn)j * * * , 

there vdll be determined a network of curves that will intersect 
in the points 

(^Ij 2/l)? (^2? y^} (^3j Vs)} ’ * * J (^nj Vr^j * * * . 

Corresponding to any point whose rectangular coordinates are 
(x, y) there will be a pair of curves u = const, and v = const., 
which pass through this point. The totality of numbers {u, v) 
defines a curvilinear coordinate system, and the curves them- 
selves are called the coordinate lines. 

Thus, if 

u — 

V = tan“^ 

X 

the family of curves u = const, is a family of circles, whereas 
V = const, defines a family of radial lines. The curvilinear 
coordinate system, in this case, is the ordinary polar coordinate 
system (Fig. 37). 



Consider the element of area dA in the curvilinear coordinate 
system (u. v) (Fig. 38) bounded by a quadrilateral 
the boundary of which is formed by the curves 

^ = /i(^. y), u + du-=^ /i(x, y ) ; 

^ y), V + dv / 2 (x, y). 
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The positive quantities du and dv are assumed to be finite but 
may be chosen as small as desired. 

The rectangular coordinates (xi, y{) of the point Pi can be 
calculated from ( 46 - 2 ). Thus, 


= vi{u, v), 
Vi — <pz{u, v). 



Along the boundary P iP 2, the coordinate u does not change, so 
that the coordinates (z2, 2/2) of P2 are given by 

«2 = <pi{u, V + dv), 

2/2 = ?52(m, V -|- dv). 

Similarly, the coordinates of P3 and P4 are 

= <pi(u -f- du, v), 2/3 = <p2(u -|- du, v)] 

= <pi(u -|- du, v -|- dv), 2/4 = (pi(u du, V -f- dv). 

It follows from the theorem of the mean that 

^2 = <pi(u, V 'jr dv) = <pi(u, v) + dVj 

ov 

1)2 = <P2{u, V + dv) = <pi{u, 2 )) -f ^ dv, 

OV 

= <Pi{u + du, v) = Pi(u, v) du, 

OV 

Ds = 'p2(u + du, v) = <pi{u, «) + -r- du. 

ou 

Now the area dA of the curvilinear quadrilateral 
is approximately equal to twice the area of the rectilinear triangle 
PPoP^j and the approximation can be made as close as desired 
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by taking du and dv suffici 6 ntly small. The area of the recti- 
linear triangle is given by the deternnnant 

]xi yi 1 
^2 1 
yz 1 

where the plus or minus sign is chosen so as to make the area 
positive. 

Substituting the coordinates of the points Pi, P 2 , and P 3 
in the determinant gives 

1 ! 


dv dv 

du dv. 


du du 

Since the area of the curvilinear quadrilateral is nearly equal to 
twice the area of the triangle, one can write an approximate 
relation 

(46-3) = ±J{u, v) dudv, 

where 

d(pi 

du du 

J{u, v) = 

1 at; dv\ 

The determinant J has many uses in mathematics and is 
called the Junctional determinant or Jacobian.f 
Consider next the double integral 

Jjix, y) dA, 

* The reader, not familiar with the determinantal expression for the area 
of the triangle, will have no difficulty in deducing it from elementary con- 
siderations of analytic geometry 
t See Chap. XII. 
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over some regioa B, where f(x, y) is continuous in R. This 
integral may be expressed in terms of the curvilinear coordinates 
{u, v), by substituting for x and y from (46-2) and by making use 
of (46-3). Thus, 

(46-4) Jj(x, y) dA = »)| Jj du dv, 

where 

F(u, v) = f[cpi{u, v), cp.Xu, v)l 

Some question must be raised regarding the legitimacy of 
replacing the exact element of area dA by its approximation 
given by (46-3), but the exact element of area is equal to 

[|e7| + e] du dv, 

where € — > 0 with du and dv. 

The infinitesimal e may be neglected, since in forming the limit 
of the sum 

X, y) A A = v)\J\ du dv + v) du dv 

one can choose du and dv so small that e (and, consequently, 
the second term in the right-hand member of the foregoing 
expression) is made as small as desired. * 

Setting f{x, y) in (46-4) equal to unity gives the expression 
for the area of the region R, namely, 

(46-5) J^dA == JjJj du dv. 

In evaluating the double integrals in (46-4) and (46-5) by 
means of iterated integrals, the limits for u and v must be deter- 
mined from a consideration of the region R, as is shown in the 
following example: 

Example. Let it be required to find the moment of inertia of 
the area of the circle (Fig. 39) 

+ y^ — ax = 0, 

* A more elegant mode of exhibiting the relationship between the elements 
of area in cartesian and curvilinear coordinates is given in the next chapter. 
However, the demonstration given above has the advantage of directness of 
attack on the problem, even though it calls for a justification of the approxi- 
mation involved. 



ADVANCED CALCULUS 


152 


§47 


about a diameter of the circle. It is convenient to introduce the 
polar coordinates 

a: = p cos 6, 

2/ = p sin e, 

so that the equation of the circle becomes 

p = a cos 6. 



Fig. 39. 

Calculating the determinant J gives 

I cos 6 sin d 


J = 


so that 
Therefore, 


— p sin 6 p cos 5| 
dA = p dp dd. 


C ^ rc 

f-dA = I 
JR Jo Jo 

r^’a^ cos^ 6 sin^ d 

Jo 4 


s 

p^ sin® 6 p dp d9 


64 
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47. Transformation of Points. The discussion in Sec. 46 of the 
change of variables in a double integral leading to the formula 

(47-1) dA = \J\dudv, 

is capable of a somewhat different interpretation. The expres- 
sion (47-1) represents the element of area in the curvilinear 
coordinates defined by the equations 


(47-2) 




where x and y are thought to be the ordinary cartesian coordi- 
nates. Now’' the Eqs. (47-2) can be interpreted as the equations 
of transformation of points from one cartesian coordinate system 
y to another cartesian system u, v. 



Consider some region R in the a;^-plane (Fig. 40), and assume 
that the correspondence of points between the wt;-plane and 
the xy-plaxie is one to one. This means that (47-2) can be solved 
uniquely for x and y in terms of u and v to give the inverse 
transformation 


(47-3) 


= v), 

y = <p 2 {u, v). 


Corresponding to any point (x, y) of the region R the equations 
(47-2) determine a pair of numbers [u, v), and conversely, 
equations (47-3) determine a unique pair of numbers {x, y) for 
every point {u, v) in some region jB' of the ^^ 2 ;-plane. The 
boundary C of the region R will be mapped into some curve C' 
in the t^v-plane which will enclose the region R\ The magnitudes 
of the areas of the regions R and R' will not be equal in general. 
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The element of area dA in the 2 ;y-plane will be transformed into 
an element of area dA' in the ui'-plane, and the ratio of the 
magnitudes of these elements of area is precisely equal to the 
numerical value of the Jacobian. Therefore [see (46-5)], 

(47-4) J^dy dx = j^J/| du dv. 

The integral fdudv gives the area bounded by the curve 

C', and the factor |/| introduced in the integrand of (47-4) 
takes account of the magnification of the region B produced hy 
the transformation (47-2). This point of view is adopted in 
the treatment of the change of variables given in Sec. 60. 

PROBLEMS 

1. Evaluate ( dy dx, where R is the region bounded by the 

JR 

circle + 2/" = Use polar coordinates. Ans, 7r(l — 

2. Find the area outside p = a(l + cos S) and inside p = Za cos 6. 

3. Find the coordinates of the center of gravity of the area between 
p = 2 sin ^ and p = 4 sin 6. 

4. Calculate the elements of area in the ^^y-coordinate systems which 
are related to the cartesian coordinate system xy by means of the 
following equations of transformation: 

(a) X = u + a, y — V ~T b; 

(b) X - au^ y = hv; 

(c) X ~ u CQS a — V sin y = u sin a + V cos a; 

where a, 6, and a are constants. Interpret your results geometrically. 

5. What are the regions of integration in the m-coordinate systems of 
Prob. 4 if the region R in the xy-plane is the interior of the ellipse 


6. Discuss the curvilinear coordinate system defined by the relations 

X = u + V, 

y = u -v; 

and describe the region in the uv-phne corresponding to the square 
X = 1, X = 2, y = 1, 'y =- 2. 

7. Discuss the curvilinear coordinate system defined by the relations 
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u X- — 

V 2xy. 

Sketch the curves u = const, and v == const. 

8. Find the area of the cardioid p = a(l + cos d) by integrating first 
with respect to 6 and then with respect to p. Check your result by 
calculating the same area by integrating first with respect to p and then 
vith respect to 6. 

9. Find by double integration the area bounded by p = 2a cos 29 by 
integrating first with respect to 6. 

10. Find the center of gra^dty of one loop of the curve in Prob. 9. 

11. Find the center of gravity of the area which is bounded by one 
loop of the curve p- = 2a^ cos 29 and which is exterior to the circle 
p = a. 

12. Find the moment of inertia of the area in Prob. 11 about the 
polar axis. 

48. Change of Variables in a Triple Integral. Let the cartesian 
variables x, y, z be connected with the variables u, v, and w by 
means of the relations 

(u = fi{x, y, z), 

(48-1) h =/2(x, 2/, 2), 

(w = fs(x, y, z). 

Just as in the preceding section, it is assumed that the functions 
u, Vj and w are continuous together with, their first partial 
derivatives in some region R of the s^z/s-space, and that Eqs. 
(48-1) can be solved for y, and z in terms of u, v, and w. 

If u, V, and w are assigned fixed values ^^o, Vo and Wq, then 

(uq = fi{x, y, z), 

(48-2) z;o =f2{x,y,z), 

[Wo = Mx, y, z). 

The equations (48-2) define three surfaces, two of which intersect 
in a curve, and the third cuts the curve in a point. Thus, a 
triplet of values (^^o, tt;o) determines a point in space, and one 
can regard the totality of numbers (w, v, w) as the curvilinear 
coordinates. The surfaces = const., v = const., andty = const, 
are called the coordinate surfaces. 

The element of volume dF is enclosed by the three pairs of 
coordinate surfaces (Fig. 41) 

= y, f y, 2). = . y, 



156 


ADVANCED CALCULUS 


and 


u -\-du= fi{x, y, z), V + dv = Mx, y, z), 
w “f" div = 


where du^ dv, and div are assumed to be positive constants. 

The calculation leading to the establishment of the formula 
corresponding to (46-3) is entirely analogous to that of Sec. 
46, and all one needs to do is to calculate the volume of a parallele- 
piped that is approximately equal to the element of volume 
bounded by the coordinate surfaces 


and 


u = const., 
V = const., 
w = const., 
u + du = const., 
V + dv = const., 


w + dw = const. 



Fig. 41. 

If the solutions of (48-1) be denoted by 

X = <pi(u, V, w), 
y = <p2{u, V, w), 
z = ^ 3 ( m , V, w), 

then the elenaent of the volume is 

dV = |J| du dv dw, 
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where 

du du 

(48-3) Jiu, v,w) = ^ ^ ^ 

dv dv dv 

d<p2 d<p3 
dw dw dw\ 

The Jacobian (48-3) is frequently written in the following 
forms, which indicate exphcitly the variables under considera- 
tion, * 

<P2, 

Uj Vj w 

Then 

y, z) dV = \f{u, V, w) ■ du dv dw, 

dJ It \w, Vj W/ 

where 

F(u, V, w) = fl^i(u, V, w), ip^iu, V, w), (pz{u, V, w)]. 

An interpretation of the naeaning of the Jacobian, analogous 
to that of Sec. 47, is immediately available if one prefers to think 
of Eqs. (48-1) as defining the transformation of the points of 
the region E into the points of the region R' in a cartesian coordi- 
nate system (w, v, w}. The results of this and the preceding 
sections can easily be generalized to more than three dimensions. 

49. Spherical and Cylindrical Coordinates. Corresponding 
to the system of polar coordinates in the plane, there are two 
systems of space coordinates which are frequently used in prac- 
tical problems. The first of these is the system of spherical, or 
polar, coordinates. Let P(x, y, z) (Fig. 42) be any point whose 
projection on the a;2/-plane is Q{x, y). Then the spherical 
coordinates of P are p, <p, 9, in wLich p is the distance OP, ^ is the 
angle between OQ and the positive x-axis, and 9 is the angle 

* Another notation commonly used to denote the Jacobian is 

3( m , V, w) 



See Chap. XII. 
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between OP and the positive s-axis. Then, from Fig. 42 it 
is seen that 

X = OQ cos ^ = OP cos (90° - cos ^ = p sin B cos cp, 
y == OQ sin V? = P sin B sin tp, 
z = p cos B, 



Fig. 42. 

The element of volume in spherical coordinates can be obtained 
by means of (48-3). Since 

sin 6 cos <p 

p sin B sin (p 

p cos cos 
= — p- sin 

it follows that 

(49-1) = P“ sin 6 dp d(p dB. 

This element of volume is the volume of the solid bounded by the 
two concentric spheres of radii p and p + dp, the two planes 
through the 0 -axis which make angles of (p and <p + d<p with the 
x 0 -plane, and the two cones of revolution whose common axis 
is the 0 -a.xis and whose vertical angles are 26 and 2(^-1- dd). 

The second space system corresponding to polar coordinates 
in the plane is the system of cylindrical coordinates. Any 



sin 6 sin cp cos 9 

p sin B cos (p 0 
p cos ^ sin — p sin 6 
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point P{x, y, z), whose projection on the rry-plane is Q (Fig. 43), 
has the cyhndrical coordinates p, 6, z, where d is the angle between 
OQ and the positive x-axis, p is the distance OQ, and z is the 



Fig. 43. 

distance QP, From Fig. 43 it is evident that x — p cos 
2 / = p sin 6^ and z ^ z. Since 


cos sin 0 

— p sin 0 p cos 0 0 
0 0 1 


it follows that 

(49-2) ’ = pdpdd dz. 

This element of volume is the volume of the solid bounded by the 
two cylinders whose radii are p and p + dp, the two planes 
through the 2 ;-axis which make angles 6 and 6 + dd with the 
a; 2 -plane, and the two planes parallel to the a^^z-plane at distances 
z and z + dz. 

Example 1. Find the ^^-coordinate of the center of gravity of 
the solid of uniform density o- lying in the first octant and bounded 
by the three coordinate planes and the sphere x^ + + z^ = 
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Since 


it is necessary to compute f x dV. This integral can be cal- 
culated by evaluating the iterated integral 

but it is easier to transform to spherical coordinates. Then, 




p sin 6 cos (p ‘ p2 sin 6 dp dS dcp 
sin^ B cos cp dd d<p 



Therefore, 


16 3a 

X = 

T 

Example 2. Let it be required to calculate the moment of 
inertia h of the cylinder used in the illustration of Sec. 45 by 
transforming the integral into cylindrical coordinates. Then 

r pa p2ir pb 

= (p^ sin^ B dp 

‘a /-2x/ ^ 

dB dp 

= O' lo Jo I ^P^ sin^ e + '^) dB dp 
p® sin 2B ^ h^pj\ 
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= (Tj [rhp^ + dp 

n — ^ “(3a2 + 46“). 

50. Surface Integrals. Another .important application of 
multiple integrals occurs in defining the area of a surface. The 
surfaces considered in this section are assumed to have two well- 
defined sides. If one draws two oppositely directed normals 
PN and PN^ at any point P of a two-sided surface (Fig. 44) 
and allows the point P to move along any path which does not 
cross the edge of the surface, then the direction of the moving 
normal PN can never be made to coincide with that of PN\ 



AT 



There are surfaces that have one side only. Thus a strip 
of paper glued in such a way that the upper side of one end of the 
strip is joined onto the under side of the other end mil form a 
one-sided surface (Fig. 45). If two oppositely directed normals 
PN and PN^ are drawn at any point P of this surface, then the 
normal PN, carried along the path P4.BCP, will eventually 
coincide in direction with PN\ 

Let z —fix, y) be the equation of a surface S (Fig. 46). The 
function z = fix, y) is assumed to have continuous first partial 
derivatives with respect to x and y. This implies that a con- 
tinuously turning tangent plane is uniquely defined at every 
point of the surface S, 

Let S' be a portion of S bounded by a closed curve C, and such 
that any line parallel to the 2 :-axis cuts S' in only one point. 
If C' is the projection of C on the xy-plane, let the region R, 
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of which C is the boundary, be subdivided by lines parallel to 
the axes into subregions ARi. Through these subdividing lines 
pass planes parallel to the z-axis. These planes cut from S' 
smaU regions of area A<ri. Let AAi be the area of ARi. 
Then, except for infinitesimals of higher order, 

A-4i = cos 7 i A<Ti, 

where cos cos |3i, and cos yi represent the direction cosines 



of the normal to S at any point (xi, yi, z,) of AjS-. Since (see 
Sec. 28) 


cos o-i: cos i3,-:cos yi = 


— 

dx\i'dy 


it follows that 


C0S7< = 


-1 


dxji 


Using the positive value for cos yi, 


Affi = sec 7 i AAi = \ 



Then 
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is defined as the area of the surface S'. Since this limit is 


the value of a is given by 

(50-1) a = I sec 7 dii = 

Jr 

Similarly, by projecting 8 on the other coordinate planes, it 
can be shown that ’ 

— fg, sec adA = sec dA. 

The integral of a function if>(x, y, z) over the surface 2 = f(x, y) 
can now be defined by the equation 

(50-2) (p{x, y, z) da - 

Js' 

/ + ( I )’ + 1 * 

Th© outlin© of the reasoning leading to this definition is as 
follows: The surface is divided into regions AS^ whose areas 
are Let Pi{xi, yi, z^) be any point in AS< and form the sum 


The limit of this sum as ^ co , in such a way that every Acr^ 0, 
is called the surface integral of <p{x, y, z) over S' and is denoted by 

{x, y, z) da. 

This integral can be evaluated with the aid of the formula (50-2). 

To ensure the existence of the limit, it is sufficient to assume 
that the function <p(x, y^ z) is continuous and single-valued for 
all points of the surface S'. 

Example 1. Find the area of that portion of the surface of 
the cylinder x^ + y^ which lies in the first octant between 
the planes z Q and z = mx (Fig. 47). 
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This surface can be projected on the a:z-plane or on the yz-plane 
but not on the a:!/-plane (since any perpendicular to the a:y-plane 
which meets the surface of all vdll lie on the surface). The 
projection on the xz-plane is the triangle OAB. Hence 


But 





Fig. 47 . 

Therefore, 

~ J‘ dx = ahn. 

Example 2. Find the surface of the sphere = a?- 

cut off by the cylinder x"- — ax ^ (Fig. 48). 

From symmetry it is clear that it will suffice to determine the 
surface in the first octant and multiply the result by 4. Now, 

M 

and since z = ^a- — x^ - y^, 

dz —X ^ 

dx — x^— dy 
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Thus, the integral becomes 
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\/ax-x‘ a dy dx 
0 a- — X- - 


It is simpler to evaluate this integral by transforming to cylin- 



drical coordinates. The equation of the cylinder becomes 
p — a cos 6, and that of the sphere 

z = - 2 /- = 

Thus, 



Example 3. Find the ^j-coordinate of the center of gravity of 
one octant of the surface of the sphere a;- + 2/“ + 

Now, 


§ = 



2 



:) +i^.) +1 


a 

2 


adx dy 
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PROBLEMS 

1. Find the Tolume bounded by the cylinder and the sphere of 

Example 2, page 164. A'ris. V == -a 

2. Find the surface of the cylinder cut off by the cylinder 

3. Find the coordinates of the center of gravity of the portion of the 
surface of the sphere cut off by the right-circular cone whose vertex is 

at the center of the sphere. Aws. x = a cos^ 

4. Use cylindrical coordinates to find the moment of inertia of the 
volume of a right-circular cylinder about its axis._ Ans. 

5. Find the moments of inertia of the volume of the ellipsoid 


about its axes. Ans. Iz = ^ 5 a&c(a^ + 6^). 

6. Kinetic energy T is defined as T = where M is the mass 

and V is the velocity of a particle. If the body is rotating with a constant 
angular velocity oj, show that 

T = 

where p is the density and I is the moment of inertia of the body about 
the axis of rotation. 

7. Find the coordinates of the center of gravity of the area bounded by 

a: = 0, and y = 0. 

8. Find the moment of inertia of the area of one loop of sin 2B 

about an axis perpendicular to its plane at the pole. 

9. (a) Find the expression for dA in terms of u and y, if a; = -^(1 — v) 
and y — uv; 

(h) Find the expression for dV in terms of w, v, and w,ilx = — v)j 

y — uv{l — w), and z = iww, 

10 . Find the center of gra\nty of one of the wedges of uniform density 

cut from the cylinder -1- by the planes z = mx and z = —mx, 

11. Find the volume enclosed by the circular cylinder p = 2a cos 6 , 
the cone z — p, and the plane z — 0 (use cylindrical coordinates). 

12. Find the center of gravity of the solid of uniform density bounded 

by the four planes - + ^+ -=1, a: = 0, ^ = 0, and g = 0. 

d 0 C 

13. Find the moment of inertia of the solid of uniform density bounded 

by the cylinder x^ + = oP- and the planes z = 0 and z — b about the 

2 -axis. 
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14. Find, by the method of Sec. 50, the area of the surface of the 

sphere + ^- + which lies in the first octant. 

15. Prove that 


. y, M, V 

Hint: Write out the Jacobians and multiply. 

16. Prove that 


where u = y), v = v{x, y), x = ), and 2 / = y{^, 7 ]). 



61. Green’s Theorem in Space. An important theorem that 
establishes the connection between the integral over the volume 
and the integral over the surface enclosing t6e volume is given 
next. This theorem has wide applicability in numerous physical 
problems and is frequently termed the divergence theorem, 

kjP 

Theorem. If P(x, y, z), Q{x, y, z), R(x, y, z) and 
dHi 

— are continuous and single-valued functions in a region T hounded 
hy a closed surface Sj then 
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■■ dy^ i 

It will be assumed that S (Fig. 49 ) is cut by any line parallel to 
one of the coordinate axes in at most two points. If S is not 
such a surface, then T is subdmded into regions each of which 
satisfies this condition, and the extension to more general types 
of regions presents no difficulty. 

A parallel to the s-axis may cut S in two points {xi, yi, Zi) and 
(xi, yi, Zi), in which < 2*. Let 2 == fi(x, y) be. the equation 
satisfied by {xi, yi, and 2 = f^ix, y) be the equation satisfied 
by {xi, yi, 2i). Thus S is divided into two parts: Si, whose equa- 
tion is 2 = Si{x, y ) ; and 1S2, whose equation is 2 = f‘i{x, y). Then 

y, z) cos y da, 

taken over the exterior of S, is equal to 

y, 2) cos 7 do- + V, ^) cos 7 do-, 

taken over the exteriors of the surfaces Si and S^, But, from 
( 50 - 2 ), these surface integrals are equal to double integrals taken 
over the projection T of T on the xtz-plane. Therefore,* 

y, 2) cos yd(T = y,Mx, y)] - 22 [x, yji{x, y)]] dA 




T dz 


dz dy dx 


or 


R{x, y, 2) cos 7 dcr 
Similarly, it can be shown that 




Tdz 


dV. 


X 


P{x, y, 2) cos a d<x 


-I 


dx 


dV 


* The negative sign appears in the right-hand member of the equation 
because 

cos 72 rfcTo = —cos 7i d(Ti, 
where the subscripts refer to ;Sf2 and ;Si. 



§61 

and 


MULTIPLE INTEGRALS 


169 


Q{x, y, z) cos |S d<r 


Therefore, 


jTdy ' 


(51-1) J^(P cos a -f Q cos jS -f cos 7 ) iff 


Since cos ada = dy dz, cos ^ dff = dz dx, and cos y dcr = dx dy, 
(51-1) can be written in the form 


(51-2) 


=m. 


, §Q , 

T\dx dy dz 


The formula (51-2) bears the name of Green.* 

Example. By transforming to a triple integral, evaluate 


^ - ffP 


+ x^y dz dx + xH dx dy). 


where S is the surface bounded hjz = 0,z = b, and x- + ^ a^. 

Calculating the right-hand member with the aid of (51-2) 
and making use of the symmetry, one finds 

^ ^ + a:® -h x^) dz dy dx 

= 4 ■ 5b dx 

= ^7ra%. 

A direct calculation of the integral I may prove to be instructive. 
The evaluation of the integral can be carried out by calculating 
the sum of the integrals evaluated over the projections of the sur- 
face S on the coordinate planes. Thus, 

I = ~ y^y dz dy - f“J'o\-Va- - V'Ydz dy 

-f- 0.2 — x^ dz dx — ~~ -s/ a? — xr) dz dx 

+ r* r^ ° (a^—y^) bdx dy— f“ (a^—v^) Odxdy, 

*The names of Gauss and Ostrogradsky are also associated with this 
theorem. 
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which upon evaluation is seen to check with the result obtained 
above. It should be noted that the angles a, /3, j are made by 
the exterior normal with the positive direction of the coordinate 
axes, 

52. Symmetrical Form of Green’s Theorem. One of the most 
widely used formulas in the applications of analysis to a great 
variety of problems is a form of Green’s theorem obtained by 
setting 

dv dv 


in (51-1). The result of the substitution is 


C f dv , dv ^ . dv 
I ~ cos a + -:r cos jS -h ^ cos 7 

Js \dx dy dz 

dh 


do- 




du dv .dudv. du dv 
dx dx dy dy dz dz 


But the direction cosines of the exterior normal n to the surface 
are 


cos a = 


dx 

dn 


cos S = 


dy 

dn’ 


cos 7 = 


dz 

dn 


so that the foregoing integral reads 



where 


r 

J dx dy dy dz dz 


. dh) , dh 


Interchanging the roles of u and v in (52-1) and subtracting the 
result from (52-1) give the desired formula 
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A reference to the conditions imposed upon P, Q, and R in 
the theorem of Sec. 51 sho'W’s that in order to ensure the validity 
of this formula, it is sufficient to require the continuity of the 
functions u and v and their first and second space derivatives 
throughout a closed region T. 

PROBLEMS 

1. Evaluate, by using Green’s theorem, 

/// 

where S is the surface x- + 

2. Show from geometrical considerations that the angle dd subtended 
at the origin by an element ds of a plane curve C is 

dd = cos(n, r) ^ 

where r is the radius vector of the curve, and (w, r) is the angle between 
the radius vector and the normal to the curve. Hence, show that 

cos (n, r) d$ r 1 dr 

c Jc r dn^ 

where the integral is a line integral along the curve C. 

3. A solid angle is defined as the angle subtended at the vertex of a 
cone. The area cut out from a unit sphere by the cone, with its vertex 
at the center, is called the measure of the solid angle. The measure of 
the solid angle is clearly equal to the area cut out by the cone from any 
sphere concentric with the unit sphere divided by the square of the 
radius of this sphere. In a manner analogous to that employed in 
Prob. 2 show that the element of solid angle is 

, cos(n, r) da 
do> == f 

where the angle between the radius vector and the exterior normal to 
the surface is (n, r). Also show that 

;os (n, r) da 1 dr 


where the integral is extended over the surface S. 

4. By transforming to a triple integral, evaluate 
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where S is the spherical surface x- + y‘^ + = or- Also attempt to 

calculate this integral directly. 

5. Set z.' = 1 in Green’s sj^mmetrical formula and assume that u satis- 


fies the equation of Laplace: = 0. 


J r* 

— 
B dn 


dcr]i S 


is an arbitrary closed surface? 

6- The density’ of a square plate varies directly as the square of the 
distance from one vertex. Find the center of gravity and the moment 
of inertia of the plate about an axis perpendicular to the plate and 
passing through the center of gravity. 

7. Find the volume of a rectangular hole cut through a sphere if a 
diameter of the sphere coincides with the axis of the hole. 

8. Show that the attraction of a homogeneous sphere at a point 
exterior to the sphere is the same as though all of the mass of the sphere 
were concentrated at the center of the sphere. Assume the inverse 
square law of force. 

9. The NevTonian potential V due to a body T at a point P is defined 

by the equation V{P) = where dm is the element of mass of the 

body and r is the distance from the point P to the element of mass dm. 
Show that the potential of a homogeneous spherical shell of inner 
radius b and outer radius a is 


V = 2t<t(o- ~ if r < b, 

and 


if 


where cr is the density. 

10. Find the Newtonian potential on the axis of a homogeneous 
circular cylinder of radius a. 

11. Show that the force of attraction of a right-circular cone upon a 
point at its vertex is 2Tcrh(l — cos a), where h is the altitude of the cone 
and 2q; is the angle at the vertex. 

12. Show that the force of attraction of a homogeneous right-circular 
cylinder upon a point on its axis is 


where h is altitude, a is radius, and R is the distance from the point to 
one base of the cylinder. 

13. Set up the integral representing the part of the surface of the 
sphere x- + y- z- — 100 intercepted by the planes z = 1 and x = 4, 

14. Find the mass of a sphere whose density varies as the square of 
the distance from the center. 

15. Find the moment of inertia of the sphere in Prob. 14 about a 
diameter. 
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16. A circular hole of radius h is drilled through a sphere of radius a. 
What is the volume drilled out if the axis of the hole coincides with a 
diameter of the sphere? 

17. A circular hole of radius b is drilled through a circular cylinder of 
radius a in such a way that the axis of the hole coincides with a diameter 
of the cross section of the cylinder. What is the volume drilled out? 

18. Set up the integral for the area of the surface of the sphere inter- 
cepted by a right-circular cylinder one of whose elements contains a 
diameter of the sphere. Evaluate this integral if the radius of the 
cylinder is equal to one-half the radius of the sphere. 

19. If a sphere is inscribed in a right-circular cylinder, then the 
surfaces of the sphere and the cylinder intercepted by a pair of planes 
perpendicular to the axis of the cylinder are equal in area. Prove it. 



CHAPTER VI 
LINE INTEGRALS 


63. Definitioa of Line Integral. Consider a continuous curve 
C (Fig. 50) joining the points A and B, whose coordinates are 
{a, h) and (c, d). Let M{x, y) and Nix, y) be two single-valued 

and continuous* functions of x 
and y for all points of C. Divide 
the curve C into n arcs by- 
inserting n — 1 points Pi whose 
coordinates are [xi, y,), and define 

and 

Ayi = yi- 2/i_i, 

Fig. 50 . = L 2, • • • , n, where 

xa = a, yo = h, Xn = c, yn = d. 
On each of the n arcs choose a point {^i, rn), and form the sum 

(53-1) 

The limit of this sum as <» and every Axi and At/,- tends to 
zero is defined as a line integral along the curve C, or in symbols 

lim 



• Nix, y) dy]. 

* A function F{x^ y) is continuous along the curve C if it is continuous at 
every point of C. The continuity at a point (a;o, 2/0) of the curve C means 
that lim F{x^ y) = F{x^^ y^) when the point (x, y) approaches (2:0, 2/0) along 

Cj that is, \F{Xj y) — F{xq, 2/o) 1 < e for all points of the curv^e C that satisfy 
the inequalities \x < 77 and \y - yo| < 77, 

174 
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The fact that the limit of the sum exists independently of the 
mode of subdivision and of the choice of the points (f.-, 17.) 
follows directly from the existence of the ordinary definite integral 
if the curve C is assumed to be such that it can be broken up into 
a finite number of monotonic arcs. For, let the equation of the 
curve C be 

y = /(a:), 

and assume that C is such that a line parallel to either of the 
coordinate axes meets the curve in, at most, one point* (Fig. 51 ). 



Divide this curve into n arcs by inserting the points of sub- 
division Pi, {i = 1 , 2, • • • , n — 1 ), the coordinates of which 
satisfy the conditions 

a ^ Xo < Xi < Xi < • ■ ■ < Xn-l <Xn=C, 

b = yo < yi < ya < • • • < yn-i <y„ = d, 
and form the sum 

(53-2) AXi. 

Since M[x, /(x)] is a continuous function, the limit of the sum 
(53-2) as n — ^ 00 is precisely the ordinary definite .integral, so 
that one can write 

n 

lim i?i) Axi s (‘M[x, f{x)] dx. 

i — 1 

* This is equivalent to saying that the function f{x) is monotone. 
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Denote the inverse of y = fix) by a; == (piy); then a precisely 
similar argument shows that 

lim 

2=1 

= f^‘‘N[<p(^), y] dy. 

Thus the line integral 
(53-3) 

can be expressed as the sum of two definite integrals if the curve 
C is continuous and monotone. This discussion can be extended 
in an ob^dous way if the continuous curve C can be subdivided 
into a finite number of pieces each of which is monotone. 

It is clear from the foregoing that the magnitude of the line 
integral depends, in general, on the choice of the curve C joining 
the points A and 5, but it should be noted that the definition 
of the line integral does not require the existence of the derivative 
affix). 

If the equation of the curve C is given in a parametric form as 

) 

y=Mt), iU<t< h), 

where fiit) and f^it) possess continuous derivatives, one can 
express the line integral (53-3) as a definite integral by sub- 
stituting for a; and y in terms of t. Thus, 

fj.Mix, y) dx + Nix, y) dy] 


where and h are the values of the parameter t which correspond 
to the coordinates of the end points A and B, 

If the equation of the curve is given in the form y = /(x), 
where fix) is a continuous function, then dy = fix) dx, and 
substitution in the line integral (53-3) gives the definite integral 

fj.Mix, y) dz + Nix, y) dy] = £{M[x,fix)] + N[x, fiz)]f iz)] dx. 

It follows from the properties of definite integrals that the 
line integral along the curve C from the point A to the point B 
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is the negative of the line integral from jB to il along the same 
curve. 

Example 1. Let the points (0, 0) and (1, 1) be connected by 
the line y = x. Let M{x, y) = x - y‘'- and N{x, y) = 2xy. 
Then the line integral along y = 

^ ^ ~ + ^^2/ dy], 

becomes, on substitution of y = x, 

£\(x - x^-) dx + 2x2 dx] =J^\x+ X-) dx = %. 

If (0, 0) and (1, 1) are connected by the parabola y = x", I along 
y = X“ is 

J^lix - x^) dx + 2x^(2x dx)] = £\x + 3x^) dx = ij^o- 
Example 2. Consider 

ilf(x, y) — 2x2 + ixy 
and 

N{x, v) = 2x2 _ 2 / 2 , 

with the curve y = x"^ connecting the points (1, 1) and (2, 4). 
Then 

dx + N dy) = J"(2x2 + 4x • x2) dx + j^{2v - y^) dy 

= m. 

Inasmuch as dy = 2x dx, this integral can be written as 

+ 4:X^) dx + - x^)2x dx = 13%. 

If the equation of the parabola in this example is written in a 
parametric form as 

X — t, 

{l<t< 2), 

then the integrand of the line integral can be expressed in terms 
of the parameter t Substituting for x, y, dx, and dy in terms of 
t gives 

/*( 2 , 4 ) /*2 

[M dx + N dy] = [{2P + 4f) 4- (2t2 - t*)2t] dt 

= JJ\2t2 + Si* - 2r) dt = 13%. 
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The reader will readity verify that the value of this integral 
over a rectilinear path C joining the points (1, 1) and (2, 4) is 
also 13r3- In fact, the value of this integral depends only on 
the end points and not upon the curve joining them. The 
reason for this remarkable behavior will appear in Sec. 56. 


PROBLEMS 


1. Find the value of dx + (x - y) dy] along the foEowing 

•/ (0,UJ 


(а) straight line x - t, y - t; 

(б) parabola x ~ i-, y - t\ 

(c) parabola x — t,y — 

{d) cubical parabola x - i, y — 

2. Find the value of dx + {x- - y-) dy] along (a) y = 

(6) y = Zx. ^ 

3. Find the %'alue of {x° dx + dy) along the curves of Prob. 1 
above. 

4 . Find the value of + y^) dx - 2xy dy] along (a) y = z] 

(6) X = y^; (c) y = x-. 

{y sin xdx — X cosy dy) along y ^ x. 

(0,0) 

6. Find the value of / ’ {x dy y dx) along the upper half of the 

Ji-a,0) 

circle -f ?/- = a-. 

7. Evaluate the integral of Prob. 6 over the path formed by the lines 
X = —a,y = a,x-a. What is the value of this integral if the path 
is a straight line joining the points (—a, 0) and (a, 0)? 

8. Find the value of I ’ {x- dx + y"^ dy) along the path given by 

•/ (IjO) 

a; = sin 2/ = cos t. 

9. Evaluate the integral of Prob, 8 if the path is a straight line joining 
(0, 1) and (1, 0). 

10. W^hat is the value of the integral of Prob. 8 if the path is the curve 
2/ = 1 ~ a;-? 


^64. Area of a Closed Curve. Let C be a continuous closed 
curve which nowhere crosses itseh. The equation of such a 
curve, in parametric form, can be given as 


(54-1) 


a: = /i(<), 

y = 
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where the parameter t varies continuously from some value 
t = to to t — h and the functions fi(f) and f 2 (t) are continuous 
and single- valued in the interval ^ ^ Inasmuch as the 
curve is assumed to be closed, the initial and the final points of 
the curve coincide, so that, 

fiito) = 

and 

Mu) = /2(^i). 

The statement that the curve C does not cut itself implies 
that there is no other pair of values of the parameter t for which 

Mn 

and 

Mn=^Mn 

A closed curve satisfying the condition stated above will be 
called simple. 

As t varies continuously from to U, the points (x, y) deter- 
mined by (54-1) will trace out the curve C in a certain sense. If 
C is described so that a man walk- 
ing along the curve in the .direction | 
of the description has the enclosed ^2 
area always to his left, the curve C 
is said to be described in the 'positive 
direction, and the enclosed area will 
be considered positive; whereas if C 
is described so that the enclosed 
area is to the right, then C is 
described in the negative direction, 
and the area is regarded as negative. 

Consider at first a simple closed 
curve C such that no line parallel 
to either of the coordinate axes ' 52 . 

intersects C in more than two 

points. Let C be bounded by the lines x ai, x = a2, y = bi, 
y = 62 , which are tangent to C at Ai, A%, Bi, and B2, respec- 
tively. Clearly C cannot be the graph of a single-valued 
function. Therefore, let the equation of A 1 JB 1 A 2 be given by 
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yi = and the equation of A 1 B 2 A 2 by yz — fzix), where 

fi(x) and Mx) are single-valued functions. Then the area 
enclosed by C (Fig. 52) is given by 

(54-2) A = £yz dx - dx 



or 

(54-3) A = -jf^dx, 

in which the last integral is to be taken around (7 in a counter- 
clock\\nse direction. 

Similarly, if Xi — ^ 1 ( 2 /) is the equation of BiAiB' 2 , and = <^ 2 ( 2 /) 
is the equation of BiA^B^- 


or 


(54-4) 


A = J2~X2 dy - dy 
= £y-dy + £x^dy 

A=f^xdy. 


Again, the last integral is to be taken around (7 in a counter- 
clockwise direction. It may be 
noted that (54-3) and (54-4) both 
require that the area be to the 
left as C is described if the value 
of A is to be positive. 

By adding (54-3) and (54-4), a 
new formula for A is obtained, 
namely, 





(54-5) A = dx + x dy). 


Fig. 53. 


This formula gives a line-integral 
expression for A. 

To illustrate the application of (54-5), the area between 
(1) = 4?/ and (2) t/* = 4a: (Fig. 53) will be determined. 
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Then 




{-y dx + X dy) 


■5X,<- 


y dx X dy) 


ifX- 


~dx + x-^dx) + 


_ 


r 

241 


3 ■ 


+ 5 1 (-ydx + xdy) 
^J(2) 


For convenience the first integral was expressed in terms of x, 
whereas the second integral is simpler in terms of y. 

The restriction that the curve C be such that no line parallel 
to either of the coordinate axes cuts it in more than two points 
can be removed if it is possible to draw a finite number of lines 
connecting pairs of points on C, so that the area enclosed by 
the curve is subdivided into regions each of which is of the type 
considered in the foregoing. This extension is indicated in 
detail in the following section. 


PROBLEMS 

1. Find, by using (54-5), the area of the ellipse x = acos y = bsin 

2. Find, by using (54-5), the area between ~ 9x and y — 3a;. 

3. Find, by using (54-5), the area of the hypocycloid of four cusps 
X - a cos^ Q^y = a sin^ d. 

4 . Find, by using (54-5), the area of the triangle formed by the line 
y — a and the coordinate axes. 

5. Find, by using (64-5), the area enclosed by the loop of the strophoid 


X 


1 - ^2 
1 + ^2’ 


y 


1+^2 


55. Green’s Theorem for the Plane, This remarkable theorem 
estabhshes the connection between a line integral and a double 
integral. 

Theorem. If M{x, y) and N{x, y)j and ^ are continuous, 

dngle-valued Junctions over a closed region B, hounded by the curve 
C, then 
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The double integral is taken over the given region, and the curve C is 
described in the positive direction. 

The theorem mil be proved first for a simple closed curve 
of the type considered in Sec. 54 (see Fig. 52). 

Again let yi — fiix) be the equation of AiBiA^ and = f^lx) 
be the equation of AiB^Ai. Then 



or 

(55-1) J dxdy= - j^M {x, y) dx. 

Similarly, if a;i = <(>-y{y) is the equation of BiAiBa and X 2 - (Piiy) 
is the equation of B 1 A 2 B 2 , 




-f 

Jbi 


[N(x 2 ,y) -N{xi,y)]dy 


N{x 2 , y)dy + 1^ Nixi, y) dy, 


or 


(55-2) j ~ 


Therefore, if (55-2) is subtracted from (55-1), 

(55-3) f dx dy = - f[M{x, y) dx + N{x, y) dy] 


It wiU be observed that setting M = —y and N = x gives the 
formula (54-5). 

Now let the region have any continuous boundary curve C, so 
long as it is possible to draw a finite number of lines which 
divide the region into subregions each of the type considered in 
the first part of this section; that is, the subregions must have 
boundary curves which are cut by any parallel to either of the 
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coordinate axes in at most two points. Such a region B is shown 
in Fig. 54 . 

By drawing the lines A1A2 and 43^4, the region R is divided 
into three subregions Ri, R^, and R3. The boundarj' curve of 
each region is of the simple type. The positive direction of 
each boundary curve is indicated by the arrows. The theorem 
can be applied to each subregion separately. When the three 
equations are added, the left-hand members add to give the 



double integral over the entire region R. The right-hand 
members give 

- f[M dx + N dy] - CjMdx + Ndy] - f [Mdx + Ndy], 

JCi JCz JCz 

where 

C2 = AiA^ + + A3A4 + A4A1, 

Since each of the lines AiA^ and ^13^4 is traversed once in each 
direction, the line integrals which arise from them will cancel. 
The remaining line integrals, taken over the arcs of C, add to 
give the line integral over C. Therefore, 

holds for regions of the type K 
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Another type of region in which an auxiliary line is introduced 
is the region whose boundaiy^ is formed by two or more distinct 
curves. Thus, if R (Fig. 55) is the region between Ci and C 2 , the 
line A 1 A 2 is drawn in order to make the total boundary 

Cl + A2A1 + C2 + A1A2 

a single curve. The theorem can be applied, and the line 
integrals over A 2 A 1 and AiA% will cancel, leaving only the line 
integrals over Ci and C 2 . 

If the region R is such that any closed curve drawn in it can, 
by a continuous deformation, be shrunk to a point without 



crossing the boundary of the region, then the latter is called 
simply connected. Thus, regions bounded by a circle, a rectangle, 
or an ellipse are simply connected. The region R exterior to 
C 2 and interior to Ci (Fig. 55) is not simply connected because a 
circle dravm vdthin R and enclosing C 2 cannot be shrunk to a 
point without crossing C 2 . In ordinary parlance, regions that 
have holes are not simply connected regions; they are called 
multiply connected regions. The importance of this classification 
will appear in the next two sections. 

Example. Evaluate by using Green’s theorem 


where C is the closed path formed by ^ = a;, and from 

(0, 0) to (1, 1) (Fig. 56). Since M = and N = y^. 


dy 


= 


and 


m 

dx 


= 0 . 
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Then, 


PROBLEMS 

1. Find, by Green’s theorem, the value of 


dx A- y dy) 


along the closed curve C formed by = x and y = x between (0, 0) 
and (1, 1). 

2. Find, by Green’s theorem, the value of 


■y)dx+ (x - 2 / 2 ) dy] 


along the closed curve C formed by y^ = x^ and y — x between (0, 0) 
and (1, 1). 

3. Use Green’s theorem to find the value of 

Jj.{xy - x^) dx + x^y dy] 

along the closed curve C formed by y — 0, x — 1, and y = x, 

4. Use Green’s theorem to evaluate 


along the closed path formed by y = 1, x 4, and y = 

5. Check the answers of the four preceding problems by evaluating 
the line integrals directly. 


56. Properties of Line Integrals. 

Theorem 1. Let M and N be two functions of x and y, such that 


M, N, and are continuous and single-valued at every point 
of a simply connected region R. The necessary and sufficient 
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condition that jpi dx + N dy) = 0 around every clo&sd curve- 
C drawn in R, is that 


for erery point of B. 
Since 


dy dx 


^^x + N 




•dy, 


where A is the region enclosed by C, it follows that 


dM m 
dy dx 


makes the double integral, and consequently the line integral, 
have the value zero. Conversely, let f^(M dx + Ndy) = 0 
around every closed curve C drawn in B. Suppose that 


aM 0 

dy dx 


at some point P of R. Since ^ and ^ are continuous func- 
tions of X and t/, 

dM BN 
dy dx 

is also a continuous function of x and y. Therefore, there must 
exist some region S about P, in which — — has the same 

sign as at P. Then 


and hence j (M dx + N dy) ^0 around the boundary of this 
region. This contradicts the hypothesis that 


f(Mdx + Ndy) = 0 
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around every closed curve C drawn in R. It follows that 

m 

dy dz 

at all points of R. 

Example 1. Let 

M = — and N = 


Then 


^ ^ ^ - a:2 

dy dz (z- + 

M, N, and ^ are continuous 

dy dz 

and single-valued for all points of 
the xy-plane except (0, 0). Hence 

dz +Ndy) =0 around any 

closed curve C (Fig. 57) which 
does not enclose (0, 0). In polar 
change of variables, 



coordinates, obtained by the 


z = p cos 9, 

-y 7 . 


2/ = p sin 6, 


- 


If C does not enclose the origin, 9 varies along C from its original 
value 9o back to 9o. Therefore^ = 0. If Ci encloses the 

origin, 9 varies along Ci from 9o to 9o + 2x, so that f d9 = 2ir. 

JCi 

Example 2. Find, by Green’s theorem, the value of 


I = +3:y)dx + (y^ -b x"-) dy], 


where C is the square formed by the lines y = ±1 and x = ±1. 
Since 
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Note that the line integral has the value zero, but — • 

This does not contradict Theorem 1. Why? 

Theorem 2. Let M a7id N satisfy the conditions of Theorem 1. 

J *(x,2/) 

(a &) dx N dy) 

he independent of the curve connecting (a, 6) and {x, y) is that 

n T\ r n y 

^ = ^ at all points of the region R. In this case the line inte- 
dy dx 

gral is a f unction of the end points 
only. 

^ dM dN r , rf j 

Suppose — = Let Ci and 

Co (Fig. 58) be any two curves from 
A to P, and let 



P(x,y) 


and 


Fig. 58. 


: f^pi dx + N dy) 
h = f{M dx + N dy) 


be the values of the line integral from A to P along Ci and C^, 
respectively. Then Ji — 72 is the value of the integral around 
the closed path formed by Ci and Ci. By Theorem 1, 

7i — 72 = 0. 


Therefore, 7i = 72, so that the line integral taken over any two 
paths from A to P has the same value. 

Conversely, suppose thatj* (M dx + N dy) is independent of 
the path from A to P. Then, for any two curves Ci and C 2 , 
7i = 72. It follows that'J* {M dx + N dy) — 0 for the closedpath 


formed by Gi and 
Example. Consider 



Hence, by Theorem 1, 


dy 


1 +y^ 
x^ 


dx — 


l±_x 

x^ 



dx 


Since ~ = 

dy 


2y 

x^ 


W.L1 

and ^ — —Tj and both functions are continuous 


m 

dx 


except at (0, 0), the line integral is independent of the path so 
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long as it does not enclose the origin. Choose y = 1 from 
(1, 1) to (2, 1), and x == 2 from (2, 1) to (2, 2), as the path of 
integration. Then 



Theorem 3. Lei M and A satisfy the conditions of Theorem 1. 
The necessary and sufficient condition that there exist a function 

F(x, y) such that g = M if^^t ^ ^ at all 

°y ay dx 

-points of the region R. 

„ dM dN rpr „ • 

li = -^> Theorem 2 proves that 


is independent of the path. Therefore, 


and this function F(x, y) depends only on the coordinates of the 
end points of the path. Hence, 

y\ P( x,y) P Cx-t4X.y) 

Fix + Lx, y) = 


Let the path of integration be 
chosen as a curve C (Fig. 59) from 
A to P and the straight line 
PP' fromP(z, y) toP'ix + Ax, y). 

Then, 

Fix-\-Ax,y)= +Ndy)-\- • + Ndy) 

or 

(56-2) Fix + Ax, y) = Fix, y) -b y) dx. 

The second integral reduces to the simpler form given in (56-2) 
since y is constant along PP', and therefore dy = 0. From (56-2) 



A{a,bl 


Fig. 59. 
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dx 

_ lim 

AX-i-O 


+ Ax, y ) - F{x, y ) ' 
Ax 


i-f 

,AxJx 




Mix, y) 



Application of the first mean-value theorem* 
^M{x, y) dx — Ax Mi^, y), (x ^ 


gives 

^ < X + Ax), 


Therefore, 


dx 


= lim 


i- 

Ax 


Ax M(|, y) 


Hence, 


lim M(|, y). 

Ax-i-0 


It can be proved similarly that 


The function F is really a function of both end points. Multiply- 

dF dF 

ing — = Mix, y) by dx and — = Nix, y) by dy gives 

Thus, if 

m 

dy 

the integrand in j^(M da; -1- iV dy) is the exact differential 

of the function Fix, y), which is determined by the formula 
(56-1). 

The most general expression for a function i>(a;, y), whose 
total differential is d^ = M dx + N dy, is 


* See Sec, 37. 
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where C is an arbitrary constant. Indeed, since dF and 
are equal, 

d(F — ^) = 0, 

so that 

F — ^ = const. 

To prove the necessity of the condition of the theorem, note 
that if there exists a function F(a:, y) such that 


dx 


then 


dy dx 


y y) 

dy 


and — = 
dv 


and 


dx dy 


dx 


dM , dN . ,, dW 

Since and — are both continuous, ^ ^ and 
dy dx dx dy 

continuous, and hence, * 


are also 


dW 


dW 


dx dy dy dx 


Therefore, 


dM 

dy 


dN 

dx 


As a corollary to Theorem 3, one can state the following: 
The necessary and sufficient condition that M{x^ y) dx + N{x, y) dy 

be an exact differential is that 

dy dx 


1. Show that 


PROBLEMS 


dx 


is independent of the path, and determine its value. 
2. Test for independence of path: 


(a) /(y COS xdx + sin x dy) ; 

(b) JKx^ - y^) dx + 2xy dy]; 


^ See Sec. 31. 
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(c) J'[(® — y") <^2/]; 

(d) J* [(x’ — y-) dx — 2(x — l)y dy]. 

J 0 , 0 ) L 


3. Show that . i , n 

the path and find its value. 

4. Show that the line integral 


y 


(1 + xy 


d ( 


- 1 / dx 


X dy 


is independent of 


evaluated along a square 2 units on the side and with center at the origin 
has the value 27r. Give the reason for failure of this integral to vanish 
along this closed path. 

6. Find the values of the following line integrals: 


(«) 

(h) 

(c) 


r®) . , . 

I {y cos xdx + sin x dy). 

J (0.0) 



J(o,o) LVi-«- 

( 2 , 3 ) 

[ix +l)dx+ {y + 1) dy\. 


r ( 2 , 3 , 
J(i,i) 


J 


67. Multiply Connected Regions. It was shown that the 
necessary and sufficient condition for the vanishing of the line 

integral y) dx + N{x, y) dy] around the closed path C 

is the equality of and ^ at every point of the region enclosed 
ay dx 


by C. It was assumed that C was drawn in a simply connected 
region R and that the functions M{Xj y) and N{x^ y)^ together 
with their first partial derivatives, were continuous on and in 
the interior of C. The latter condition w^as imposed in order to 
ensure the integrability of the functions involved. The reason 
for imposing the restriction on the connectivity of the region 
essentially lies in the type of regions permitted by Greenes 
theorem. 

Thus consider a region R containing one hole (Fig. 60). The 
region R wdll be assumed to consLst of the exterior of (72 and the 
interior of (7i. Let a closed contour C be drawn, which lies 
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entirely in R and encloses -Ca. Now, even though the functions 
M(x, y) and N(x, y) together with their derivatives may be 

continuous in R, the integral Jj.Mix, y) dx + N(x, y) dy] 

may not vanish. , For, let K be any other closed curve lying in R 
and enclosing Ca, and suppose that the points A and B of K 
and C be joined by a straight line .45 Consider the integrals 


f.iPA Jab Jbqb 



where the subscripts on the integrals indicate the direction of 
integration along the curves K, C, and along the straight line AB, 
as is indicated in Fig. 60. Since the path AB is traversed twice 



in opposite directions, the second and the last of the integrals 
above will annul each other, so that there will remain only the 
integral along K, traversed in the counterclockwise direction, 
and the integral along C, in the clockwise direction. Now if M 
and N satisfy the conditions of Theorem 1, Sec. 56, then 

f^^[M dx+ N dy] + f^^[M dx + N dy] = 0, 

where the arrows on the circles indicate the direction of integra- 
tion. Thus 

(57-1) f^^[M dx + N dy] = fjM dx + N dy], 

both integrals being taken in the counterclockwise direction. 

The important statement embodied in (57-1) is that the 
magnitude of the line integral evaluated over a closed path in R, 
surrounding the hole, has the same constant value whatever be 
the path enclosing C3. This value need not be zero, as is seen 
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from a simple example already mentioned in Sec. 56. Thus, 
let the region R consist of the exterior of the circle of radius 
unity and with center at the origin and of the interior of a con- 

centric circle of radius 3 (Fig. 61). The functions M — ^o" ^2 



and N = and their derivatives, obviously satisfy the 

X- + y- 

conditions of continuity in R and on Ci and C 2 . Also, — — • 
But 


-y dx 



where C is the circle 

X = a cos d, 

y = a sin 6, (1 < a < 3), 

gives 

sin^ 6 + eos^ 0 _ 2 ^^ 


The function F{x, y), of which Af(x, y) dx + N{xj y) dy is 
an exact differential, is F(Xj y) = tan”^ -j which is a multiple- 

7 V 7 ^ 


valued function. 
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The function 

y"> y) ^y'^^ 

where M and N satisfy the conditions of Theorem 1 ^ Sec. 56, will be 
single-valued if the region E is simply connected (as is required 
ill Theorem 1) but not necessarily so if the region is multiply 
connected. 

58. Line Integrals in Space. The line integral over a space 
curve C is defined in a way entirely analogous to that described 
in Sec. 56. 

Let C be a continuous space curve joining the points A and 5, 
and let P{x, y, z), Q(Xj y, z), and R{x, y, z) be three continuous, 
single-valued functions of the variables x, y, z. Divide the 
curve C into n arcs As{ (i = 1, 2, • • * , n), whose projections 
on the coordinate axes are Axi, Ayi, Azi, and form the sum 

n 

Vi, fi) Aa:; + Q(^i, rn, ii) Ayt + R{^i, ry, AzJ, 

where 77^, fi) is a point chosen at random on the arc Afj. 
The limit of this sum as n increases indefinitely in such a way 
that each ASi 0 is called the line integral ofP dx + Qdy + R dz, 
taken along C between the points A and B, It is denoted by 
the symbol 

(58-1) V, 2) + Q,{^, y, 2) dy 4- B{x, y, z) dz]. 

The conditions imposed upon the functions P, Q, and R are 
sufficient to ensure the existence of the limit, provided that the 
curve C is suitably restricted. 

If the equation of the space curve C is given in parametric 
form as 

{x = Mi), 

(58-2) {y=Mt), 

(z = Mi), {to ^ it), 

where Mi), Mi), and Mi) possess continuous derivatives in the 
interval to ^ t < ti, the line integral (58-1) can be expressed 
as a definite integral 
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where P, Q, and R are expressed in terms of t mth the aid of 

). 

59. Stokes’s Theorem. Simply connected regions only will be 
considered in the remainder of this chapter. A simply connected 
space region is characterized b}’ the fact that any closed curve 
drawn in it can be shrunk to a point without crossing the surfaces 
bounding the region. Thus, a cube, a sphere, a cylinder, or a 



region between two concentric spheres are examples of simply 
connected space regions. An anchor ring, or torus, is not simply 
connected. 

In considering closed surfaces, the direction of the exterior 
normal to the surface will be reckoned as positive. If the 
surface is open and two-sided (such as that of a hemisphere, for 
example), the direction of the positive normal may be taken at 
will. Let an open two-sided surface S be bounded by a closed 
curve r (Fig. 62) ; then the motion along T will be regarded as 
positive if a man walking along V with his head in the direction 
of the positive normal has the surface S to his left. 

Stokes’s Theorem. LetP{Xj y, z), Q(x, y, z), and R{x, y, z) and 
their 'partial derivatives with respect to re, y, and z he continuous 
and single-valued Junctions in a region containing the surface S 
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ivMch is hounded hy the dosed curve F. Let dS be the element 
of area of S, and let cos a, cos jS, and cos y be the direction cosines 
of the exterior normal to dS. Then 


=/£[(!-§) 


COS a 


+ 


dx ) 


COS (3 + 


^ 

\52: dy 


^dz dx 

Let z = f{x, y) be the equation of S and consider 
P(x, y, z) = P[x, y, fix, y)] = Mix, y). 
Let C be the projection of F on the rciz-plane, so that 

fpix, y, z) dx = fMix, y) dx. 
From Greenes theorem for the plane, 


cos y 


dS. 


where .4 is the pro j ection of S on the a: 2 /-plane. But 


dM _ dP dP dz 
dy dy dz dy 


so that 


ix, y, z) dx 


■ -I Li 


Since** 


dy dz dy) ^ 

dz COS j3 


dz dz . „ 

— : — 1 = COS a: cos /3: cos y, . 
dx dy dy cosy 


Moreover, 


dx dy = cos y dS. 

Therefore, 

• (59-1) JV (a;, y, z) dx = j cos ^ 


dy 


cos 7 ^ dS. 


* See Sec. 28. 
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Similarly, it can be shown that 
(59-2) 


(59-3) 


By adding (59-1), (59-2), and (59-3), 


(59-4) 



dx + Qdy + Rdz) — 




cos jS + 



dz 


COS Oi 



cos 7 


dS. 


Using the fact that cos a dS = dy dz, cos ^ dS = dz dx, and 
cos ydS = dx dy, (59-4) can be written in the form 


{«9-5) J^. 

dR dQ 
dy dz 

By means of this theorem, it is possible to derive three theorems 
analogous to those given in Sec. 56 for line integrals in the plane. 
Since the proofs of these theorems are similar to those given in 
Sec. 56, they vill be omitted here. 

Theorem 1. Let the region of space considered he one in which 
P(x, y, z), Q(Xj and B{x, y^ z) and their partial derivatives are 
continuous and single-valued functions of x, y, and z. Then the 
necessary and sufficient condition that 

J{P dx + Qdy + Rdz) =0 


arou7id every closed curve in the region is that 


dP __ dQ dQ _ dR dR _ dP 

dy dx^ dz dy^ dx dz 


for every point of the region. 

Theorem 2, Let the functions considered satisfy the conditions 
of Theorem 1. Then the necessary and sufficient condition that 
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he independent of the path from (a, b, c) to (x, y, z) is thai 

dy dx’ dz dy’ Bx Bz’ 

for every point of the region. 

Theorem 3. Let the functions P, Q, and R satisfy the conditions 
of Theorem 1. Then the necessary and sufficient condition that there 
exist a f unction F(x, y, z), such that 

dF dF 

is that 

^ as m 

dy dx' dz dx dz' 

for every point of the region. The function F(x, y, z) is given by the 
formula 


y, dx + Q dy + R dz). 

Corollary. The necessary and sufficient condition that 
P dx + Qdy + Rdz 

he an exact differential of some function ^{x, y^ z) is thai 

^ ^ ^ dR m dP 

dy dx ' dz dx 

for every point of the region. The function ^{x, y, z) is determined 
from the formula 


, y, z) = ■ Qdy + Rdz) + const. 

60. Applications of Line Integrals. 

1. Change of Variables in a Double Integral. A formula for the 
change of variables in a double integral was developed in Sec. 
46j and it is advisable to review Secs. 46 and 47 before reading 
this section. A more elegant, though less direct, derivation of 
the relation established there is given below with the aid of the 
concept of the line integral. 

Consider again the equations of transformation of Sec. 46, 
(60-1) a; = i,v), y = cp^iu, v), 
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where cpiiu, v) and <p^iu, v) together with their first partial 
derivatives are continuous in the region under consideration. 
The equations (60-1) may be regarded as the equations of trans- 
formation from one set of rectangular cartesian axes u, v to 
another set of rectangular axes y. The area A of the region R 
enclosed by the curve C is given by the formula (54-4), 

A = f^xdy. 

Substituting for x and dy from (60-1) gives 

(60-2) A = v) d<p 2 (u, v), 

where C' is the boundary of the region J?' in the ti?;-plane, which 
corresponds to the region E in the xy-plsine. 

But 

■d^,(u, v) =^du + ^ dv, 

SO that the integral (60-2) becomes 

A = du -f- v)^-^ dv^ ■ 

Setting 

and 

N{u, v) = 

and appl 3 dng Green’s theorem (Sec. 55) gives 
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d<pi 

du du 

J (u, v) = 

1 dv dv 

It follows from the mean-value theorem for double integrals 
(see problem in Sec. 42) that 

dA = \J{^j r])\ du dv. 

The absolute value bars were introduced in the foregoing because 
the area is essentially positive. 

2. Work. It will be assumed that a force F(Xj y) acts at every 
point of the a;2/-plane (Fig. 63). 

This force varies from point to 
point in magnitude and direc- 
tion. An example of such con- 
ditions is the case of an electric 
field of force. The problem is to 
determine the work done on a 
particle moving from the point 
A (a, b) to the point £(c, d) along 
some curve C. Divide the arc 
AB of C into n segments by the 
points Pi, P2, . . . , Pn-i, and 
let Lsi = PiPi+i. Then the force acting at Pi is F{xi, y^. 
Let it be directed along the line PS^ and let PiT be the tangent 
to C at Pi, making an angle Bi with PS^ 

The component of force F{xi, yi) along PiT is F cos 6i and the 
element of work done on the particle in mo\dng through the 
distance As* is approximately F{xi, yi) cos Bi As,-. The smaller 
ASi, the better this approximation will be. Therefore, the work 
done in moving the particle from A to P along C is 

n — l 

W = lim yi) cos d. Asj = fF(x, y) cos 9 ds. 

n—^ 00 

1 = 0 

If a is the inclination of PS and is the inclination of PiT, 
then 

d = a — and cos 0 = cos a cos sin a sin jS, 
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so that 


(60-3) W = 2 /) (cos a -cos p + sin a sin /3) 

From the definition of a it is evident that 

F cos O' = x-component of / = X, 

F sin o: = y-component of F ^ Y. 


Moreover, since ^ = cos and 

cos P ds — dx and 
Therefore (60-3) becomes 


dy 


= sin /3, 


ds 

sin ^ ds = dy. 


W = f^ix dx + Y dy), 

which is a line integral of the form (53-3). 

If C is a space curve, then an argument in every respect 
similar to the foregoing shows that the work done in producing a 
displacement along a curve C in a field of force where the com- 
ponents along the coordinate axes are X, Y, and Z is 


W = j^iXdx + Ydy + Zdz). 

To illustrate the use of this formula, the work done in displac- 
ing a particle of mass m along some curve C, joining the points 
A and B, will be calculated. It will be assumed that the particle 
is moving under the Newtonian law of attraction 


F = 



where k is the gravitational constant and r is the distance from 
the center of attraction 0 (containing a unit mass) to a position 
of the particle (Fig. 64). 

The component of force in the direction of the positive x-axis 
is 

Z = F cos {x, r) = — ^ • -• 

Similarly, 


km y 


and 


Z 


km z 
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-(x dx + y dy + ^ dz). 


r = + 2 /“ + 2 ;^ and dr 


— ^dx + y dy + zdz 


Therefore, 


W = —hm r ~ == km - j 
Jat- Ir jA 


which depends only on the coordinates of the points A and B 



Fig. 64. 


and not on the path C. Denoting the distances from 0 to A 
and B by ti and r 2 , respectively, gives 


= kJi - 1). 

V2 ^1/ 


The quantity ^ = — is known as the gravitational potential 
of the mass m. It is easily checked that 


so that the partial derivatives of the potential function ^ give 
the components of force along the coordinate axes. Moreover, 
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the directional derivative of ^ in any direction s is 

dx , dy dz 
ds dx ds dy ds dz ds 

== X cos {Xj s) + Y cos (y, s) + Z cos ( 2 , $) 


where Fs is the component of force in the direction s. 

A conservative field of force is defined as a field of force m 
which the w^ork done in producing a displacement between two 



fixed points is independent of the path. It is clear that in a 
conservative field the integral 


along everv closed path is zero, so that the integrand is an exact 
dift'erential. 

3. Flow of a Liquid. Let C be a curve on a plane surface across 
which a liquid is flowing. The xy-plane will be chosen to coincide 
with the surface. The lines of flow are indicated in Fig. 65 by the 
curved arrows. It will be assumed that the flow of one liquid 
takes place in planes parallel to the xy-pla^m, and that the depth 
of the Liquid is unity.. The problem is to determine the amount 
of hquid urxat flow^s across C in a unit of time. 
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If Vi is the velocity of the liquid and ai is the inclination of the 
tangent to the line of flow at Pi, then vj., — lu cos a; is the 2 :-com- 
ponent of Vi and Vy\{ = v, sin is the y-component of Vi. Let 
ASi denote the segment PiPij.i of C. A particle at Pi ^vdll move 
in time At to Pf while a particle at Pj+i vill move to P'-^i. 
Therefore, the amount of liquid crossing PiPi^i in time At 
is equal to the volume of the cylinder whose altitude is unity 
and whose base is PiPi^iP^^iP'-. Aside from infinitesimals of 
higher order this volume is AF.- = PiP’i ■ PJPi^i sin 6i, in which di 
denotes the angle between PiP< and PtPi+i. But PiPi+i = ASi 
and, except for infinitesimals of higher order, PiP'^ = ViAt. 
Therefore AFi = a,- At ■ Asi sin di. The volume of liquid crossing 
C in a unit of time is 

V = lim ■ sin di As,-. 

If Ti denotes the inclination of the tangent to C at Pi, then 
Ti = d{ + ai. Therefore, 

aj sin di ASi = af(sin Ti cos at — cos n sin ai) ASi 

= Vi cos ai sin Ti ASi — Vi sin aj cos Ti ASi 

Hence, 

(60-4) F = '«xdy) 

is the line integral which gives the amount of liquid that crosses 
C in a unit of time. 

If the contour C is a closed one and the liquid is incompressible, 
then the net amount of liquid crossing C is zero, since as much 
liquid enters the region as leai^es it. This assumes, of course, 
that the interior of C contains no sources or sinks. Thus, a 
steady flow of incompressible liquid is Gharacterized by the 
equation 

dx + Vx dy) = 0, 

over any closed contour not containing sources or sinks. This 
implies that (see Sec. 56) 

dVy 

dy dx^ 


(60-5) 
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which is an important equation of hydrodynamics known as the 
equation of continuity. Moreover, from Theorem 3, Sec. 56, it is 
known that there exists a function ^ such that 


(60-6) 


-r- = —Vg and 
dx dy 


This function is called the stream function, and it has a simple 
physical meaning, since 




-Vy dx 


represents the amount of liquid crossing, per unit time, any curve 
joining (a, b) with (x, y). 

The function defined by the integral 

(60-7) ^(x, y) = dy), 

is called the velocity potential. It is readily shown that 

(60-8) f = and ^ 

Comparing (60-6) with (60-8), it is seen that 

These are the celebrated Cauchy-Riemann differential equations. 

If the integral (60-4) around a closed curve C does not vanish, 
then the region bounded by C may contain sources (if V is 
positive) or sinks (if V is negative). The presence of sources 
or sinks is characterized by the singularities of the function 
that is, those points for which ^ is not continuous or where its 
derivatives may cease to be continuous.* 

The foregoing discussion is readily generalized to a steady 
flow of liquids in space. Instead of the integral (60-7) one will 
have 

$(a:, y, z) = dx + Vy dy + dz), 

* See in this connection Sec. 67. 
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and if this integral is independent of the path C, the equations 
corresponding to (60-5) are 

dVx __ ^ dVz ^ dVy dVx 

dy dx dy dz 

In such a case the integrand is an exact differential, and the 
velocity potential y, z) gives 


dx 

4. Thermodynamics. If p, v, and U are the pressure, volume, 
and internal energy of a gas enclosed in a receptacle, then they 
are connected by the equation 

(60-9) 0, V, V) = 0. 

Hence, the state of a gas is completely determined from (60-9) 
by specifying any two of the three quantities, say f and v, 
which can be regarded as representing the coordinates of a 
point P in the p^;-plane. If the state of the gas changes, the 
point P describes a curve C, and if the process is cyclic, the curve 
C will be a closed one. 

It is important to know the amount Q of heat lost or absorbed 
by the gas w^hile the gas in the receptacle (for example, steam 
in an engine cylinder) changes its state. Let Ap, At;, and AC/ 
be the increments of pressure, volume, and energy when the 
amount AQ of heat is added. Then 

AQ — AC/ -f- pAt;. 

If p and V are considered the independent variables, then U is 
determined from (60-9), giving C/ = C7(p, v). Hence, approxi- 
mately. 


dp 


Ap+ — At,. 


Therefore, except for infinitesimals of higher order, 
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As the state of the gas changes, p and v vary along a curve C 
in the py-plane, and it is clear that the total amount of heat 
introduced into the gas during this change is 

The integral (60-10) is obviously of the form 

v) dp + N(p, v) d»]. 

If, during the expansion of the gas, there is no gain or loss of 
heat, then the process is called adiabatic. It is characterized 
by the equation dQ = 0. 


PROBLEM 

Show with the aid of (60-5) that the velocity potential $ satisfies 
the equation of Laplace, 



CHAPTER VII 
INFINITE SERIES 


61. Infinite Series. Let Ui, « 2 , uz, • ■ • , w„, be any 
sequence of quantities; then the symbol 

(61-1) Ml ■+ M„ + 

is called an infinite series. With the aid of the symbol (61-1) 
one can form a new sequence {s;} whose elements are sums of a 
finite number of the terms of the series (61-1) : 

Si = Ml, 

So = Ml -(- M2, 


Sn = Ml -f- M2 -h Ms + • • • -h M„, 


The numbers s,- will be called the fth 'partial sums of the series 
(61-1). 

“ CO 

Definition. An infinite series ^m„ is said to converge if the 

sequence of partial sums {sj} is convergent. A series which does 
'not converge is called divexgeni. 

Stated in symbolic form this definition of the convergence 
of an infin ite series is* 

(61-2) lim s„ = S, or \S - s„| < e, for all n>p. 

The number S is frequently called the sum of the series (61-1), 
although one should clearly realize that it represents the limit 
of the partial sums s„. 


* See Sec. 3. 
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A necessary and suflacient condition for convergence of any 
sequence was given in Sec. 5, and it will be restated here for 
easy reference. 

A necessary and sufficient condition for the convergence of 
Un is that for any e > 0 , one can find a 'positive integer p {depend- 
ing on e) such that 

— SmI < € 

whenever n and m both exceed p. 

It is clear that the series cannot converge if its partial sums 
Sn are unbounded, that is, if can be made greater than any 
preassigned positive number M. However, the boundedness 
of partial sums does not ensure the convergence, as can be seen 
from the simple example of the series 


Here = 1, sg == 0, 53 = 1 , • * • , § 27.-1 = 1, « = 0 , 

and the §„ are clearly bounded, but the sequence 

1 , 0 , 1 , 0 , 1 , . . . 

does not converge. 

Infinite series possess some properties which follow directly 
from the definition of convergence and from the fundamental 
criterion of convergence of sequences: 

(A) The convergence or divergence of a series ^ Un is not destroyed 

n = l 

by adding to or subtracting from it a finite number of terms. 

This follows directly from the fundamental criterion. Let 
the series be convergent; then for any 6 > 0 one can find a posi- 
tive integer p such that for any pair of numbers m > p and 
n > p, 


This condition, certainly, remains* unaltered by the addition (or 
subtraction) of a finite number of terms. To be sure, the sum of 
the series will be altered by the addition (or subtraction) 
of a finite number of terms, but the property of convergence wiE 
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not be affected. Thus, if the sum of the series is <S, then 

n = 1 

the addition of a finite number of terms ai + ct 2 + • * * + ajb 
■will give for the sum of the new series S + ai + as + • • • + a*. 
A similar argument can be supplied if the series diverges. 


(B) The limit of the general term Un of the series ^ Un is neces- 


n = l 


sarily zero if the series is convergent 
For 

Un ^ Sn 

and if the series converges, then 

lim Sn — S and lim Sn-i == S. 

n — >■ « n — >• w 


Thus, 


lim Un = lim s„ — lim s„_i = S — S = 0. 


n— «» n- 


The condition enunciated is necessary but not sufficient, 
that is, a series may diverge even though lim Un = 0. A classical 

n— »■ 00 

example illustrating this case is the harmonic series 

‘+i + i+---+s+-"- 


in which Sn increases without limit as n increases, as will be 
shown next. 

Since 

1 1 , . . , 1 
n + 1 n + 2 n + n ^ 2n 2^ 

it is possible, beginning with any term of the series, to add a 
definite number of terms and obtain a sum greater than 34* 
li n = 2, 

M + 

n = 4, 

K + + M + 

n = 8, 

M + Ko + • • • + 3^6 > 3^; 
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n = 16, 

Mt + Ks + • • - + ^2 > M- 

Thus it is possible to group the terms of the harmonic series* 

1 + M + (K + M) + (M + M + K + M) + * • • 

in such a way that the sum of the terms in each parenthesis 
exceeds 3^, and, since the series 

1 +M + K + K+ • • • 

is obviously divergent, the harmonic series is divergent also. 


(C) Let the sum of the series ^ Un he S. If a new series is formed 

n = l 

hy multiplying each term by a constant k to form the series 

kui d- ku2 "b ’ * ■ d“ kun d” * * * > 

then the sum of the latter series is . 

For, let 

Sn = d” Un 

and 

si = kui + ku2 d“ * d- kUn] 

then 

= kSn- 

Hence, 

lim si — k lim Sn = kS, 


(D) Given the two convergent series 

ui U2 • ' * d“ "b 


and 


* The fact that the associative law holds unrestrictedly for series of 
positive terms follows from the fact that the partial sums of the series 

( 1 ) + W2 + * ‘ • + Ur) + (Wr+l + ■ - • + 
are subsequences of the partial sums of the series 

( 2 ) ui A U2 uz Un A * * * • 

Hence^ (1) and (2) will diverge or converge together. 
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Let the sum of the first series be U and that of the second be V, then 
the series 


(61-3) (wi + Vi) -f (w 2 + + vf) 

has the sum U ± V. 

Let 

Sn = -j- -l- 
^ = -f- -{- 

then 


+ s'= + 

but this is precisely the rath partial sum of the series (61-3), 
which can be designated by s". 

Then 

lim (s„ ± s') = lim s" 


or 

17 + T = lim s'f. 

n—J- eo 

This result can be stated as follows: 

Convergent series may be added or subtracted term by term. It 
should be noted that this property has been established for a 
particular mode of addition. It will be seen below that the sum 
of the series may depend on the order in which the terms are 
added. 

62. Series of Positive Terms. This section will be concerned 
exclusively with series whose terms are nonnegative numbers. 
The property (A) of the preceding section states that one can 
discard any finite number of terms without affecting the con- 
vergence of the series, so that the conclusions of this section, 
in regard to convergence, will also be applicable to any series 
containing a finite number of negative terms. 

Theorem 1. A series of positive terms is necessarily convergent if 
its partial sums are bounded. 

Since the terms of the series are positive, the partial sums 
will form a monotone-increasing sequence of numbers, that is,* 

Si < S2 S3 ^ ^ Sn ‘ ? 

* The equality sign allows some terms to be zero. 
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and a bounded monotone sequence is necessarily convergent 
(see Sec. 6). 

00 

Theorem 2. If is a convergent series of -positive terms, 

n = l 

and {a„} is any hounded sequence of 'positive numbers j then the 
00 

series ^ a^Un is convergent, 

n = l 

Since the numbers a„ are bounded, 

o„ < M. 

CO 

Then the nth partial sum of ^ a^Un is less than Msn, where s„ 

n= 1 

is the nth partial sum of From Theorem 1 it follows that 

UnUn is convergent, since its partial sums are bounded. 
Example 1. Consider 


a” = a + 

n—l 

(а) If a > 1, Sn ^ n so that the partial sums are not bounded, 
and hence, the series diverges. 

(б) If a < 1, the series is a convergent geometric series. For 
the sum of n terms of a geometric progression of ratio a is* 



— a 1 — a 1— a* 

Thus, 

1 — d 

* The sura of n terras of a geometrical progression of ratio r and whose 

^ , . . a(l - r”) 

first term is a is Sn 

1 — r 
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SO that the partial sums are bounded. Consequently the series 
converges. In fact, lim s„ = - since lim a"+i = 0, if 

n“-> 00 Id oc 

a < 1- 

Example 2* Consider 

1 . 1 . 1 . . 1 

1*2 ‘ 2*3 ^ 3-4”^ ' n{n 

This series can be written as 


Hence, the nth partial sum is 


Sn — 1 


n + 1 


Thus, Sn is bounded, so that the series is convergent. 

00 00 

Theorem 3 (Comparison Test). Let ^ and ^ Vn be two series 

of positive terms, the first of which is known to be convergent and 
the second divergent. 


(a) If the terms of a given series ^ an of positive terms are such 

n = l 

00 

that dn ^ Un, for every n > m, then the series ^ dn is convergent. 


(6) If the terms of a given series ^ of positive terms are such 

n = l 

CO 

that dn ^ Vnj for every n > m, then the series ^ is divergent. 

71 = 1 

In order to establish part (a) of the theorem, assume* that 
the inequality dn ^ Un is satisfied for every term of the series, 
so that m = 1. Denote the nth partial sum of the given series 

dn by Sn, and that of the series ^ Un by )7n. Then 


This entails no loss of generality. See property {A), Sec. 61. 
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Since the sequences {sn} and {Un} are monotone increasing and 


the series ^ lu is convergent, it follows that 

n = l 

Sn ^ lim Un — U, 

n—^ 00 

Thus, the sequence {snj is bounded, and, therefore, the series 
^ ctn is convergent. 

71 = 1 

In order to prove the second part of the theorem, denote the 
00 

nth partial sum of by Fn,* then 

n = l 


00 

But, by h^^pothesis ^ is divergent, so that { Fn } is an unbounded 

n = l 


sequence, and hence ^ an diverges. 

n=l 

This test was used essentially in establishing the divergence 
of the harmonic series in Sec. 61. 


Theorem 4 (Cauchy^s Root Test). If a given series ^an of 

n = l 


'positive terms is such that 

(a) ly On ^ r < 1, for every n > m, where r is independent of 


n, then the series ^ an is convergent 

n==i 

If, however, 

00 

{b) > 1, for every n > m, then the series ^ an is divergent. 

n = 1 

There is no loss of generality in assuming that the inequalities 
(a) and (&) are satisfied for m = 1. It follows from (a) that 

Un ^ r^, 

so that no term of the given series exceeds the corresponding term 
of the geometric series 

r + + • • * + r + • • • , 
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which is convergent, since r < 1. Thus, by Theorem 3, the 
given series converges. 

The truth of the assertion of the second part of the theorem 
follows from property (5) of Sec. 61. If \/^ ^ 1, the general 
term of the given series does not tend to zero, and hence, the 
series must diverge. 

ac 

Corollary. If the given series ^ is such that 

lim \/^ = r < 1, 
then the series is convergent. 

If 


lim > 1, 

n — > 00 


then the series ^ On diverges. 

Consider first the case when r < 1, and choose a positive 
number € so small that 


r + € < 1. 

Then, for any sufficiently large n, the quantity can be 
made to differ from r by less than €, that is, 

r — €< On < r + €. 

But r + € = r' < 1, and it follows from Theorem 4 that the 
series converges. 

The proof of the case when r > 1 follows directly from property 
(5) of Sec. 61. 

Theorem 5 (d’Alembert’s Ratio Test"*"). If the terms of a series 

as ^ 

^ On of 'positive terms satisfy j from some value of n onward^ the 

n = l 

inequality 


On 


Also known as Cauchy^s ratio test. 
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where r is independent of n, then the given series is convergent 
Ifj however, from and after some value of n 


then the given series diverges. 

Let 

<r, (r < 1). 

Cijj 

Then, 

(62-1) 

and the inequality may be assumed to be satisfied for all n > 1. 
Hence, 

On ^ ra. 

an~i ^ 


Forming the product of the left-hand members and the product 
of the right-hand members of these inequalities and dividing 
out common factors give 

Un-fi ^ r^ai, (n = 1, 2, • • • ). 

Thus, the terms of the given series are less than or equal to the 
corresponding terms of the geometric series 

ai(r + r- + ' • ' + + ' • • 

which is convergent since r < 1. Hence, the given series is 
convergent by the comparison test. 

The proof of the second part of the theorem is left as an exer- 
cise for the reader. 

Corollary. If the given series ^ an is such that 

n = l 

lim = r < 1, 

n— > 00 fl/jt 

then the given series converges. 
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If 


lim 1, 

an 


then the series ^ a„ diverges. 

n^l 

The proof is identical with that of the corollary to Theorem 4, 
where ^^^±1 replaces 

Ctn 

In applying Theorems 4 and 5, to establish the convergence 


of the series 


71 = 1 


it is essential to note that 


and 


a„ 


must be less than some fixed number r smaller than unity for 
all values from some n onward. For example, in the harmonic 
series 


'%an 
n = l 



each of the expressions 


Un + 1 


and 


is always less than 1, but the series diverges. The difficulty 

71= 1 

here lies in the fact that no fixed number r, independent of n, can 
be assigned for which 


This ratio can be made to approach arbitrarily near unity, which 
is in violation of the requirement that 


< r < 1. 

Un 

In other words, an and must ultimately be less than some 

an 

fixed number r, which is smaller than unity. 
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In general, the ratio test is easier to apply than the root test, 
but the latter is more powerful. It will be seen from the example 
given below that the root test is capable of furnishing positive 
information when the ratio test fails. It may be remarked 
that the root test is always applicable when the ratio test is 
applicable. * 

The corollaries to Theorems 4 and 5 are of most frequent 
use in practical applications, but if the limits involved fail to 
exist, one may have to apply the theorems themselves. Thus, 
consider the series 

r|sin a\ + r-|sin 2q:| + • * na\ 

where a is an arbitrary constant. 

In this case 


sin (n + l)^ 
sin na 
sin (n + 
sin na 

This ratio does not approach any limit. In factf 

[sin (n + 1' 
sin na 

may assume values greater than unity as n ■ co . But the root 
test gives 


na\ == 

Thus, if r < 1, the series converges, no matter what a is. It 
should be noted here that lim an does not exist. 

n—^ 00 

As an example of the application of the corollaries to Theorems 
4 and 5, consider the series 

X + + ' * * + nx'^ + • ' * , 

* For details, see K. Knopp, Theory and Application of Infinite Series, 
Sec. 36, English edition. 

t However, it is impossible to find an integer m such that for all n m, 

sin (n 4- l)a| . 

IS greater than unity. 

sm na 
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where z > 0. The test ratio is 

5^‘ = i+i£!l = (i + iV 

On n x’^ \ n/ ’ 

and 

lim - X. 

n—> 00 CLn 

Thus the series converges if 0 < x < 1 and diverges if x > 1. 
When X = 1, the test fails, but the series 

1+2+3+ n 

is obviously divergent. 

The root test furnishes the same information, since 


But* 

lim -s/n — 1, 

so that 

lim X = X, 

n— > ao 

and if 0 X < 1, then the series is convergent. 

The series 

10 ^ 102 ^ 103 ^ T IQn ^ 

is readily shown to be divergent by the application of the ratio 
test. For 


The ratio test, in the form given in the corollary to Theorem 
5, is very easy to apply, and if it fails in a given case, one may 
attempt to find a suitable comparison series and apply Theorem 3. 


JL 

* log Vn = - log n, which tends to zero when n . Hence 
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As an illustration of this circumstance, consider 


X 


2 - 


3- 


In this case the test ratio is 


so that 


lim 


x^lso, 




so that 


lim = 1. 


Hence, neither of the tests given in the corollaries furnishes 
information regarding convergence. In this case, one may 
resort to the comparison test. 

Now consider the more general series, 


(62-2) 1 + i + i + 


+ — + 


It will be shown that this series converges for every p > 1 and 
diverges whenever 0 < p :< 1. 

The terms of the series (62-2) may be grouped as follows: 


(62-3) 


where the ifcth group contains 2^“^ terms. The sum of the terms 
in each parenthesis is less than the number of terms in that 
parenthesis multiplied by the first term. Hence, the terms of 
the series 


5 ^ 


( 2 ‘ 


- l)p) 


(62-4) 


2 ? 


are not less than the corresponding terms of the series (62-3). 
But the series (62-4) is a geometric series of ratio Hence, 
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U p > 1) the ratio is less than unity, so that (62-4), and therefore 
(62-2), will converge. 

It remains to establish the divergence of the series for p g 1. 
Note that p = 1 gives 

., 1 . 1 . . 1 . 

which is knowm to be divergent. But the nth term of this series 
is not greater than the corresponding term of the series (62-2) if 
p < 1, since 


Hence, by the comparison test, the series (62-2) diverges for 

p < 1. 

The series (62-2) and the geometric series are frequently 
used as the standard comparison series. 

A similar argument can be used to establish the divergence 
of the series 

(62 5) 2 iQg 2 3 log 3 n log n ‘ 

Let the terms of the series be grouped as is indicated below : 

1 . / 1 . 1 \ . ( 1 . . 1 

2 log 2 3 4 log 4 \5 log 5 8 log 8 

log 9 16 log 16 

Evidently, 

1 1 .. 2 ___ 1 1 ^ 

3 log 3 4 log 4 ^ 4 log 4 2 2 log 2^ 

5 log 5 ^ ^ 8 log 8 8 log 8 3 2 log 2 

1 1^8-11. 

9 log 9 + ■ ■ ■ + 16 log 16 ^ 16 log 16 4 2 log 2’ 


Therefore, the terms of the series 

+ • • • + ^+ ■ ■ ■) 
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are not greater than the corresponding terms of the given series, 
and the series (62-6) is obviously divergent. It follows that the 
series (62-5) is divergent. 

As a further illustration, let it be required to test the series 


^ d — h 


1-2 ' 3-4 


+ 


(2n — l)2n 


Here, 


lim = lim — -j — kn 

a„ „-.«(27 i -f l)(2n + 2) 


(2n - _l)2n 

r 

1 


,. in- — 2n 

= .'■“.jF+to+i " 


1 - 


2n 




1 


= 1 . 


2n ' 2^2 


Hence, the test fails, but if the given series be compared with the 
series (62-2), for p = 2, it is seen to be convergent. 


PROBLEMS 

1. Prove that 5 + ^ + ^ + *** + ^ + ••. diverges. 

diverges. 

3. Test the series 1 + ^ + ^ + • * • + + * * • . 

4. Test the series 1 + + * * * + h ' 

log 2 log 3 log n 

5. Test for convergence: 


, . 1 , 1 , 1 , 1 , . . . . 
2 2 • 22 ' 3 • 2 ^ ‘ 4 * 2 ^ ’ 

1 1-2 1 * 2 • 3 

®3 + ^ + 3-:y:7 + ---’ 

(c) 1 + 1 + 1 + • • • ; 

^ + 1 + 1 + 1 + • • • • 


Show that 1 -1- 


V'2-3 


-h 


+ • • diverges. 
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7. Show that the series 1 



convergent. 



8. Show that 


1 


i (log n)« 


converges. 


: + 


IS 


9. Show that 


converges - 


10. Show 


that ^ 


in! 


diverges. 


11. Show that diverges. 

n log n 


— cpnverges, if x > 0. 

13. Show that converges, if x > 0. 

71 = 1 
00 

2 X^ 

— converges, if 0 ^ x < 1. 

n = 1 
oo 

15. Show that diverges, if x > 0. 


63, More General Tests. The tests established in Sec. 62 are 
those most commonly used in practice. There are many more 
general criteria of convergence than those given in the preceding 
section, but their application is considerably more involved.* 
Some of the sharper criteria are discussed in this section. 

Theorem 1 (Cauchy’s Integral Test). Let ^ beagiven^ries 

n = l 

of decreasing positive terms. If there exists a positive monotone 


See, for example, Knopp, K., Theory and Application of Infinite Series. 
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decreasing function f(x) for x ^ Ij such that f(n) = a„, then the 
given series converges if the integral 


exists; the given sexies diverges if the integral does not exist 
By hypothesis fin) = a^, therefore, the ?ith partial sum of the 
given series is 


Let the values of /(z) be plotted as the ordinates (Fig. 66); 
then each term of the series can be interpreted as the area of a 



rectangle of base unity and height /(z). Each of these rectangles 
extends above the curve y = fix), so that the area of the sum of 
the n rectangles is greater than the area under the locus of z/ = fix) 
bounded by the x-svsxs, and the lines a; = 1 and x = n + l. 
Thus, 

(63-1) s„ > f"^^f{x) dx. 

On the other hand, the sum of the areas of the inscribed rectangles, 
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is less than the value of the integral i: dx, so that one 

can write 

n+1 


But 


n =2 

Hence, the inequality just above can be written as 
(63-2) s»+i < dx Oi. 

But the function y = f{x) is positive; hence 
^f{x) dx < C ““fix) dx. 

If the integral on the right converges to a value L, then it follows 
from the inequality (63-2) that 


Thus, the partial sums are bounded, and by Theorem 1, Sec. 62, 

CO 

the series converges if the integral does. If, on the other 

hand, the integral becomes infinite, it follows from the inequality 
(63-1) that the series diverges. 

It may be remarked that it is not necessary to demand that 
/(n) be equal to a„ for all values of n beginning with w = 1. 
If m is any niunber, greater than unity, and if the condition 

/(n) = On is satisfied for n > m, then the series and the 

n = 1 

integral f f{x) dx will converge and diverge together. 

Example 1. Test the harmonic series 
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Here fix) - -> since f{n) = i- Now the integral 


‘1 


and 


_ 


-dx — log n 
dx 


n — <» J 1 ^ 

SO the given series is divergent. 
Example 2. Test 


= lim log n = 


2 ^ 5 ^ 10 ^ 


Here 


and 


1+ ^2 


dx 


= tan“^ n — tan“^ 1, 


lim (tan^^ n — tan“^ 1) = -p 

n— »■ w ^ 

and, since the integral converges, the given series is convergent. 

The test of d'Alembert (Sec. 62) is merely a particular case 
of an extremely general test due to E. Kummer, from which a 
galaxy of important special tests can be deduced. 

Theorem 2 (Kummer’s Test). The series of positive terms 


^ Un is convergent if there exists a sequence of positive numbers, 
1 

{a^}, such that from some value of n onward, 

(63-3) a^— Un+i ^ r > 0. 

However, if 

(63-4) an— - 

Un+l 


then the given scries diverges, provided that the series 



diverges. 


71= 1 

It may be assumed, without loss of generality, that (63-3) 
is satisfied for n ^ 1. 
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Setting n = 1, 2, 3, 4, • • • , 72 - 1 in (63-3) gives, 


an~lUn~l — anUn ^ TUn^ 

Adding these inequalities term by term gives 

(63-5) aiui - anUn ^ r(sn - Wi), 

where Sn is the sum of the first n terms of the given series. It 
follows from (63-5) that 


or 


rsn ^ aiUi — anUn + rui, 


Thus the sum of any number of terms of the given series is 
bounded ^since is independent of and, hence, the 

series converges by Theorem 1, Sec. 62. 

In order to establish the second part of the theorem, note 
that (63-4) gives 


Hence, 


aiUi ^ a2U2 < • * • < anUn. 


and 


Un ^ CLlUi * — 7 
dn 


n — 1 


By hypothesis, the series 


diverges; consequently, the 


series ^ Un also diverges. 

n— 1 
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It will be observed that for a„ = 1, (n = 1, 2, 3, • • • ), the 
test of Kummer specializes to that of d’Alembert.* 

If the series '^ Ut. is such that lim =1, the ratio test 

n~l 

fails. A test due to Gauss frequently enables one to determine 
the behavior of the series in this doubtful case. 


Theorem 3 (Gauss’ Test). If the series ^ of ■positive terms 

n = l 

is such that the ratio — ^ can be written in the form 
u 


where A{n) is a hounded function of n as n- 5 , then the series 
converges if h > 1, and diverges if h S 1. 

The proof of this test follows from the test of Kummer. 
Consider first the case when h ^ 1, and set a„ in Kummer's 
test equal to n. Then 


= h-l. 

li h > 1, then A — 1 = r > 0, and it follows from Kummer's 
test that the given series is convergent. On the other hand, if 


A — 1 < 0, the test of Kummer ensures divergence, since 
is a divergent series. It remains to consider the case when A = 1. 


Note that the series is divergent, f and set an in 

Kummer^s test equal to n log n. Then, 

= n log + ^ + - (n + 1) log (n 

* See also Raabe’s test in Prob. 6, p. 233. 

t This fact can be readily established with the aid of the integral test of 
Cauchy; see also (62-5). 
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- (n + 1) log (n + 1) 
n ^ A (n) log n 

which tends to — 1 as n — > oc , since — 0, and 
(n 

tends to — 1 as n increases indefinitely.* 

Example 1. Consider the series 

Here 

^ “ 2n(2n + 1)‘ 

Since h = ^ and ^ the series is divergent. 

Example 2. Consider the series 

to 

• 3 • • ■ (271 - 1) 1 

2- 4 ■ 2n 

Now, 

_ (271 + 2)(27i + 3) _ 

(2n + 1)=“ 

Dividing the numerator by the denominator gives 

2n 


See See, 10, 
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and since A = ^ and 




is bounded when n — » cc , the series is convergent. 

PROBLEMS 

1. Test for convergence: 



(n - 

n=>l 


n = l 

2. Discuss the convergence of 

where p > 2 and p S 2. 

A a. Convergent if p > 2; divergent if 2? ^ 2. 

3. Discuss the convergence of 

2*4 2 • 4 • 6 

4. Discuss the convergence of 

GO 

2 • 4 • • • 2n 


1 • 3 • • • (2n - )Y 
2 • 4 ‘ • 2?z ) 


Discuss the convergence of 

‘ 3 * • • (2?i - 1) 


n=«l 


2 • 4 - — 2n 
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6. Deduce, with the aid of Kummer’s test, the following test due to 
Raabe; 


K lim n[ — 1 J >1, then the series of positive terms 

n— > \Wn+l / 

n — 0 

convergent. 

If lim nf — 1 ) <1, then the series ^ Un of positive terms is 

71—4- 00 \Un+l / 


divergent. This test frequently settles the doubtful case when 


Uji 

64. Series of Arbitrary Terms. It follows from Property (C) 
of Sec. 61 that the theorems of Secs. 62 and 63 are applicable to 
series all of whose terms are negative. It will be assumed in 

oo 

this section that the terms of the series are arbitrary real 

n — 1 

numbers, and it will be seen that the behavior of such series is 
vastly different from that of series whose terms maintain the 
same sign. 

The following theorem, which is basic in all subsequent con- 
siderations, is a restatement of the theorem of Sec. 5 on sequences 
phrased in the language of infinite series. 

Theorem, A necessary and sufficient condition for the conver- 
gence of a series ^ is that for any € > 0, one can find a positive 

n — 1 

integer N, depending on €, such that 


5n| — {^71+1 “f" atn^2 “h ’ * * “f" €, 


for n > N and every integer p ^ 1. 

It should be carefully noted that the meaning of the inequality 

[Un-j-l 


is that the sum of any number of terms of the series ^ an, begin- 
ning with an+i, must remain less than a preassigned number 
€ > 0, so long as > iV. 
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The infinite series 




obtained from the given series by discarding the first n terms, 

is called the remainder after n terms and is denoted by the symbol 

00 

Thus, if the sum of the series ^ ak is denoted by S, then 
rn = or S — Sn - r-n, 

and it is clear that r„ represents the error in approximating the 
sum S of the series by the sum Sn of n terms. The problem of 
calculating the actual value of the remainder (and, hence, 
that of the sum S of the series) is, in general, an exceedingly 
dijficult one. However, in many instances it is possible to 
obtain an estimate of the magnitude of the remainder without 
determining its actual value. This is illustrated in the follomng 
theorem, which is due to Leibnitz. 

Theorem on. Alternating Series, A series whose terms are 
alternately 'positive and negative and such that their absolute values 
form a monotone null sequence is convergent. The absolute value 
of the remainder after n terms of such a series does not exceed the 
absolute value of the {n + l)st term. 

In order to prove the theorem, consider the partial sums 

— a^ az — 

and 


By hypothesis the terms are monotone decreasing, so that the 
quantity in the parenthesis is positive. Hence, 


so that the partial sums of even orders form an increasing 
sequence. On the other hand, 

S2n = Ui — ’ (a2 — as) (^4 ” ^^ 5 ) (a2n-2 “ (l2n-l) “ <12^ 

and, since the quantity in each parenthesis is positive, 

S2n ^ ^1* 



INFINITE SERIES 


235 


This states that the increasing sequence {s 2 „} is bounded, and 
hence, it must converge to some value S. But 


and 


lim S 2 n-!-i = lim S 2 n + lim a 2 ,H-i- 

n—* w » n— ^ 00 

Since the terms of the given series form a null sequence, 


lim Gon+i = 0, 

n— w 


SO that the partial sums of even and odd orders tend to the same 
limit S. 

It remains to show that 


Note that if n is even, then 

If n is odd, then 

Tn = —C 

so that 

T-n = (Cln-f2 Ctn+s) (^n-f4 — 

< 

Thus, 

which completes the proof of the theorem. 

This theorem enables one to establish easily the convergence 
of an alternating series, since all that is necessary to show is that 

(а) |an+i| < |a„|, for all ?^ > m, 

(б) lim an ^ 0. 

71“+ w 

Example 1. The series 


is convergent since Ian+i| < \an\ for all n, and lim an — 0. The 

remainder after 1000 terms, riooo < Mooi) so that the conver- 
gence is very slow. 
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Example 2. The series 
5 7,9 11 , 

+ 7 : — -r 


has |a„4.i| < lOn] for all n, but it is divergent since lim a„ 5^ 0. 

71— 00 

Example 3. The series 

is alternating^ and lim an = 0, but it is divergent. Why? 

65. Absolute Convergence. The series ^ an is said to converge 


absolutely if ^ l^nl is convergent The convergent series which 

do not converge absolutely are called conditionally convergent 
series. 

The fact that a series may converge in the ordinary sense but 
fail to converge absolutely can be seen from the following simple 
example. It was just shown that the series 

is convergent, but the series of absolute values is the harmonic 
series 


which is known to diverge. 

00 

Theorem. A series ^ an is convergent if the series of absolute 
values ^ laTil is convergent 

Since the given series is known to converge absolutely, one 
can find a positive number N, such that 

h ‘ ‘ + |nn4-j)| < €, 

whenever n > N, and for every positive integer p. But 
+ Cln+2 “!-•••+ - 
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which is the criterion for convergence of the series an. 


Inasmuch as the series ^ |a„| is a series of positive terms, the 

n = l 

tests developed in Secs. 62 and 63 can be used to establish the 

oc 

absolute convergence of a series ^ Un. In particular, the tests 

71 = 1 

of Cauchy and d’Alembert can be phrased as follows: 

00 

Root Test If the terms an of the series ^ an from some value 

71 «= 1 

of n onward satisfy the inequality 

\/la„| < r < 1, 

then the given series converges absolutely, 

eo 

Corollary. If lim = r < 1, then the series V a„ is 

n-i- oo 

71—^1 

absolutely convergent, 

00 

Ratio Test If the terms an of the series ^ an, from some value 

71 = 1 

of n onward, satisfy the inequality 


given series converges absolutely. 

Corollary. If lim = r < 1, then series is 

absolutely convergent. 

It was shown above that a series may be convergent, but 
not absolutely convergent. If, however, 


or 
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then a,i does not tend to zero, so that the tests of Cauchy and 
d^\lembert can be used also to establish the divergence of alter- 
nating series. 

As an illustration, let it be required to determine the range of 
values of x for which the series 


2 ‘ 3 




is convergent. 

Now, the test ratio is, 


and hence, 


Qn+l 

an 


nTl 

n 


n 


'n + 1 




lim 

n-)- eo 


an 


Therefore, the series converges for all \x\ < 1 and diverges for 
all lx| > 1. When x = ±1 the test fails, but substituting 
X = 1 in the series gives 




which is convergent. Setting a; = — 1 gives 

w^hich is divergent. Thus, the series converges whenever 
— 1 < X 1. 

Series that converge absolutely possess some remarkable 
properties that are not shared by conditionally convergent series. 
It will be shovm in the next section that the sum of an absolutely 
convergent series is independent of the order in -which the terms 
of the series are added, but that this is not the case if the series 
converges conditionally. In fact, by suitably rearranging the 
terms of a conditionally convergent series, the resulting series 
can be made to converge to any desired value, or even made to 
diverge. This striking behavior of conditionally convergent 
series is illustrated by an example, and the reader will have no 
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diflSculty in constructing a general proof along the lines of the 
example. 

Consider the series 
(65-1) 

The fact that the sum of this series is less than 1 and greater 
than }4 made evident by writing the series as* 

(1 - M) + (M - K) + (H - M) + • • • , 

which shows that Sn > K forn > 2; on the other hand, the given 
series can be written as 


1 (H - Vs) - (M - M) - • • • , 

from which it is clear that < 1 for n ^ 2. 

Now if the series 

(65-2) -- H ~ M) + (M ”■ 3"^ — M) + (H — Ho ” Ha) 


is formed by an obvious rearrangement of the terms of (65-1) 
then the series (65-2) converges to only one-half the sum of the 
series (65-1). For, adding the first tw'o terms in each parenthesis 
of (65-2) gives 

) + (Ho 

= H(i - H + H - H + H - ). 

It will be shown next that it is possible to rearrange the series 


so as to obtain a new series whose sum is equal to 1. The positive 
terms of this series in their original order are 

1, Vs, H, H, H, - ‘ . 

The negative terms are 

"Mj “H; “H; . 

In order to form a series which converges to 1, first pick out, in 
order, as many positive terms as are needed to make their sum 
equal to or just greater than 1, then pick out just enough negative 


* It will be seen in Sec. 76 that the sum of this series is logc 2. 
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terms so that the sum of all terms so far chosen will be just less 
than 1, then more positive terms until the sum is just greater 
than 1, etc. Thus the partial sums will be 

Si = 1, 

^2 = 1 ~ 

s,^i--}4 + H + Vo = ^Vzo, 

55 = 1 - M - K = 

57 = 1 - M + M M + K + M 

58 = 1 - M + M + M - K + M - M = ^^^^260, 


It is clear that the series formed by this method will have a sum 
equal to 1. 

66. Properties of Absolutely Convergent Series. 

Theorem 1 (Commutative Law of Addition for Series). The 

rearrangement of the order of the terms in an absolutely convergent 
series does not alter the sum of the series. 

The theorem will be established first for a series of positive 
terms. Let the series 

(66-1) Cl “h <J2 + <^3 + • * • + + * • * 

of posithm terms be convergent to the sum S, and denote its 
nth partial sum by Suppose that the terms of the series 
(66-1) are rearranged in any way to give a series 

(66-2) &i -j- ^2 + 63 + * ’ ’ +671+ ’ ■ ■ , 

and denote the mth partial sum of (66-2) by s^. Inasmuch as 
every term of the series (66-2) appears somewhere in the series 
(66-1), and since (66-1) is convergent, it is possible to find a 
positive integer N such that Sn, for n > N, will contain all the,, 
terms appearing in and some others which do not appear in 
s^. Then 

sj^ < Sn < jS. 

It appears that the partial sums s^ are bounded, and since 
the sequence {s^} is increasing, it must approach some limit, say 

(66-3) S' < S. 

It remains to demonstrate that S' and S are equal. This can 
be shown by reversing the point of view and regarding the series 
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(66-1) as some rearrangement of the series (66-2). It was just 
shown that (66-2) has a sum S'. Therefore, for a sufficiently 
large m, s'„ -^vull contain all the terms appearing in the partial 
sum s„. Hence, 


and, since lim s„ = S, it follows that 

n—* w 

(66-4) S ^ S'. 

A comparison of (66-3) and (66-4) leads to the assertion that the 
inequality sign cannot hold, so that 

S' = S. 

Consider next an arbitrary absolutely convergent series 

ee 

^ Gn, and denote its sum by S. Form the series 


and On! - On). 

Each term of these series is positive or zero, and they are conver- 
gent since \an\ ± :S 2\an\. Now the difference of these series is 

(66-5) 

71 = 1 71 = 1 71=1 

Since both the series in the left-hand member of (66-5) are 

independent of the arrangement of the terms, their difference 
00 

2 is likewise independent, and this establishes the theorem. 


Corollary 1. If is absolutely convergent, then any sub- 

series^^ formed from it by deleting any number {finite or infinite) of 
terms is absolutely convergent. 

This follows directly from the foregoing since the partial 

sums of the subseries are bounded. 

00 

Corollary 2. If ^ an is an absolutely convergent series, and if 

71 = 1 

Ml, M 2 , * * * , Mnj is any sequence of quantities whose 
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numerical values do not increase indefinitely ^ then the series 
+ <32^1^2 +•••-}- UnMn -f- * * * 
is absolutely convergent 

This follows upon the application of Theorem 2, Sec. 62. 
Example, Consider the series 


cos X cos 


+ 


cos 


This series is absolutely convergent for all values of x because the 
series 


jL -- jL + jL _ . . . 

12 22 ^ 32 

is absolutely convergent and the numerical value of cos nx never 
exceeds unity. 

00 CO 

Theorem 2. If Un and ^ Vn are any two absolutely convergent 

ns*l 7i«=l 

senes whose sums are U and V, then they can be multiplied like 
finite sums to form the series 

( 66 - 6 ) UiVi + U 1 V 2 + U 2 V 1 + UiVz + U2V% + UzVi + • • • 


which converges absolutely and whose sum is UV, 

It is convenient to display the terms of the product series 
in the form of a rectangular array of numbers 

UiVi I j 


UzVi UzV2 


UnVi 


from which it is seen that the terms entering into (66-6) appear 
in the diagonals of the array followed from top to bottom. It 
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will suffice to show that any series formed from this array, in 
such a fashion that each term UiVj of the product appears once 
and only once in the series, is convergent absolutely. Any other 
series, and in particular (66-6), can be obtained from it by a 
rearrangement of terms. It is convenient to consider the series 
formed from the array by follo\mg the boundaries of the squares 
indicated by dotted lines, namely, the series, 

(66-7) 

UzVi UiV„ Mal'n 

tln^n 


It is assumed first that all terms in the series ^ Un and ^ Vn 

n = I n = 1 

are positive. Let Sm denote the mth partial sum of the series 
(66-7), and Un and Yn the nth partial sums of the series 


and respectively. Then 

71 = 1 

(66-8) UnVfi — 5m — t/n+lVn-fl; 

SO long as 'n} < m ^ (n + 1)^- But 

lim UnVn == lim Un^lVn+l = UV, 

71 —^ 00 71—^ oo 

and it follows from (66-8) that 

lim 5m = UV. 


Next let the series ^ Un and ^ Vn be any absolutely convergent 

71 = 1 71 = 1 

series and form the series of absolute values 

00 w 

(66-9) k»l and X I*'”!' 

n=l n=l 

The product, of the type (66-6), of these series. 
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is convergent, since each term of the series (66-9) is positive 
and it was shown that the product of such series is convergent. 
This establishes the absolute convergence of (66-6). 

As above, let be the mth partial sum of the convergent 
series (66-7), some of whose terms may be negative, and denote 
the limit of as m — » oo by S, Since 

lim Sm = S 


is independent of the manner in which m-^ co , let m assume the 
values 


Then, 

(66-10) 

But, 

and 


2 ^ 3 ^ • • • , • • • . 

lim = S. 

00 


■— TJnVfi,) 


(66-11) lim 5.2 = lim 77.7. = UV, 


A comparison of (66-10) and (66-11) shows that the sum of the 
product series (66-7) is 

S - 777. 

The particular form (66-6) of the product of two series is 
called the 'product of Cauchy ^ and it derives its particular impor- 
tance from a consideration of the products of the power series 
discussed in Chap, VIII, It may be remarked that the condition 
enunciated in Theorem 2 is suflSicient, but by no means necessary. 
If the series are conditionally convergent, the product of the two 
series depends on the particular arrangement of the terms in the 

product series. However, it was shown by Abel that if the series 
00 00 

^ Un and ^ v„ are convergent and have for their sums U and 7, 

71 = 1 71 = 1 

then if the Cauchy product (66-6) is convergent, its sum is 

necessarily UV. Mertens has shown that if one of the two 
00 00 

convergent series ^ and ^ is convergent absolutely, then 
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Cauchy’s product converges to UV. The proofs of these 
assertions of Abel and ilertens are omitted.* 

Example, The geometric series 


(66-12) 


= 


n =0 


converges absolutely if |rj < 1, and its sum is S 


1 


Hence, the product of the series (66-12) by itself, namely, 
(1 + r -b -f • • • -r r" -b • • • )(l + r + r= -b • ■ • 

_|_ _|_ . . . ) = 1 2?- -b 3r- -b • • • -b -b 

1 


is convergent to = 


(1 - ry- 

PROBLEMS 


1. Prove that ^ r” sin na converges absolutely for all values of a so 

n = l 

long as |r| <1. 

00 

Y OOS 

2. Prove that X ( — 1)” — is absolutely convergent for all values 

n — l 

of a, 

3. Show that the series 

^ Vs “ Vi) ^ (vs ^ V7 " (v9 ^ ^ 

formed by rearranging the terms of the convergent series 

V 2 Vs Vi 

is divergent. 

Hint: Note that the general term of the given series, 

1 11 

+ 


\/4n — 3 ^7471 — 1 \/^ 

* See Knopp, K., Theory and Application of Infinite Series, English ed., 
p. 320. 
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is positive and greater than 

\/An \/4n \/2n \ \/2/^n 

4. For what range of values of x do the series given below converge 
absolutely: 


v-y - 3j . . j 

^ 1*3 3'5'5‘7 ^ 

X x^ 

2 2 * 22 3 • 23 ~ 4 * 2^ + * ‘ ; 

((f) 10a; - 102a;2 + lO^aj^ - • • • ; 

, . sin a; sin 3a; , sin 5a; 

^ ^ 12 32 ^ 52 

5. Form the Cauchy products of the series (a) and (5) and the series 
(c) and (6) in Prob. 4. 

6. For what values of x is the series 


(^^2) + {x 


absolutely convergent? 

7. For what values of x is the series 


2^ , 1/ 2^ V , V 2 a; Y 

a; + 4 2\a; + 4/ 3\a; + 4/ 

absolutely convergent? Ans. — < a; < 4. 

67. Double Series. Consider an infinite array of numbers 


1, 2, 3, ■ • 

• ), arranged in the form 

ail 

ai2 

aiz 

ai4 

^21 

^22 

a^z 

a24 

^31 

a$2 

ass 

a34 

an 

an 

a43 

a44 


Clnl 0^712 ^n3 ^n4 • 



IXFIXITE SEEIES 


247 


where the first subscript on «:■; denotes the row, and the second, 
the column in w'hich the element a-- appears. 

One can. form the sum of mn terms of the array, 

Smr. = ^ ^ O;;- 
1 = 1 ;=1 

Thus, 

3 4 3 

1 = 1 j = 1 t = 1 

= ail + Ui2 + ai3 + Gi4 
+ 021 + 022 + 023 + 024 
+ Osi + ^32 + O33 + 034. 

It may happen that 

lim s,nn == S, 

jn— > « 

n>-4 » 

where w co and n 00 independently of one another. In 
such a case the symbol 

00 

i, y = 1 

is called a convergent double series. 

A reference to the preceding section shoTvS that the study 

00 BO 

of the product of two series ^Un and can be reduced to 

71 = 1 n = l 

that of the study of a double series w-hose terms are Oi/ = 

68. Series of Functions. Uniform Convergence. The 
remainder of this chapter is concerned vdth the study of series 
whose terms are functions of a real variable x. A series of 
functions of x 

( 68 - 1 ) 'i{x) + u^{x) + * * * + Un(x) + * • • 

00 

will be denoted by the symbol and it will be assumed 

n = l 

that the functions Unix) are defined in the interv’-al (a, h). 
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If X in (68-1) is assigned some definite value xi, there results 
00 

a series of constants '^Un{xi)j which may converge. If the given 

series is convergent for every value of x in the given inteml 
(a, 6), then it is said to be convergent in the interval (a, h), 

oo 

A series ^iin{x), convergent in (a, h), defines a function of x 

n- 1 

in that interval, which vill be denoted by the symbol S{x). 

00 

The sum s„( 2 ;) of the first n terms of the series ^ Un{x) is called 

n — \ 

the nth -partial mm of the series, and the statement that the 
series converges for a given value of x, say x = xi, means that 

(68-2) lim i 

n— > 00 

The definition of convergence (68-2) can be stated more explicitly 
as follows: 

CO 

Definition- The series ^ Un{x) is convergent for a given value oj 

1 

X if for any e > 0 one can find a positive integer N such that for 
all values of n ^ N 

|<S(a:) - s„(a:)| < e. 

If the sum of the terms of the series '^Un(x) beginning with 

n — 1 

) be denoted by rn(x), then 

rn(x) = Six) - Snix) = U,^i{x) -f Un+ 2 ix) + ' * ' , 
and the requirement that 

\Six) - s„(a:)| < € 


is equivalent to the statement that 
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ThuSj the assertion that the series x) is convergent for a 

given value of x = Xi means that 

lim rn(xi) = 0. 

It should be noted carefully that the definition of convergence 
just given is concerned with convergence at a given point x = Xi 
of the interval (a, b), so that the number N appearing in the 
definition depends not only on the magnitude of €, but also 
on the choice of the point x = Xi in the interval. To illustrate 
this important remark, consider the series 

XX X 

(68-3) gqjy + (a; + i)(2a; + i) + (2x + l)(3a: -f 1) 

4. . . . j 5 . . . 

^ [(n - l)x + l](nx + 1) ^ 

in the interval 0 ^ a; < 1. 

The nth term of this series can be written as 

X 1 1 

[(n — l)a; + l]{nx + 1) (n ~ l)a, + 1 nz + 

so that (68~3) can be written in the more convenient form 

0-?iT) + (jTT-sr^)+--- 

1 1 _ 

(n — l)a; + 1 nx + 1 

It is clear from (68-4) that the sum Sn(x) of n terms of (68-3) is 

s„(rc) = 1 r-^ = ]— 7* 

nx + 1 na; + 1 

Hence, 




lim Sn{x) ^ S{x) — lim 


nx 


o^nx + 1 


= 1, if X 9^ 0, 


Thus, if X 0, 


nx 
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Now let it be required to determine the magnitude of N, 
corresponding to a prescribed e, such that for all w ^ iV 

Vn{x)\ < €. 

Since 


the condition lrn(a:) 1 < e becomes 


nx + 1 

Solving for n gives 

(68-5) » > - l). 

from which it is clear that N depends not only on e, but also 

QQ 

on the magnitude of x. Thus, if e = 0.01, (68-5) gives n > —; 

and for x — N can be chosen to be 199. If e = 0.01 but 

X = yii ^ must be at least 4 • (99) + 1 = 397. It is clear that 
if € is fixed and x is allowed to assume values nearer and nearer 
to zero, then the value of N must be chosen larger and larger. 

The series (68--3) converges for all values of x in the interval 
0 < re < 1, but it is impossible to find a single number N which 
vdll satisfy the inequality (68-5) uniformly well, that is, for every 
value of X in the interval (0, 1). However, there are series of 
functions of x for which it is possible to find one number iV, 
which does not depend on the particular choice of x in the interval 
and thus depends on e alone. 

An example of such a series is 


(68-6) a(.) = (i^ - + . ■ ■ 

. / nx^ {n — l)a:^ \ 

\1 H- wa: 1 -|- (w — l)x) 

where x is assumed to lie in the interval 0 a; :< 1. 


+ • • • , 

Obviously 


s»(a;) = 


nx^ 

1 -^-nx 
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S{x) = lim SrXx) = lim:}— r- — 

fi — j- sc ti — f X 1 “i 71X 

Consequently, 


Tnix) = S{x) - SrXx) 


71X“ _ X 

1 + ? 2 x 1 + nx 


The requirement that rn(x) < e is, in this case, 


1 + nx 

Sohdng this inequality for n gives 

(68-7) „ > 1 _ I 

€ X 

The inequality (68-7) shows that N again is a function of 
both € and x, but there is an important distinction in the char- 
acter of the inequalities (68-5) and (68-7). If e = 0,01 and 
X = > 100 “ 2 = 98, so that N can be chosen to be equal 

to 99. If € = 0.01 and x = then n > 100 — 4 = 96, and 
N may be any number greater than 96. If e = 0.01 and x = 
the least value of N is 99. It is clear that N remains bounded, 
regardless of what value of x is chosen in the interval (0, 1), for 
N = 100 will satisfy the inequality (68-7) with e = 0.01 
uniformly well for 0 :< a; <, 1. 

Thus, it is seen that the reason for the difference in the beha\dor 
of the two series is that for the first of them N does not remain 
bounded (e fixed) when x is allowed to assume various values 

in the interval, whereas in the second case the choice of N = - 

€ 

vdll serve uniformly w^ell in the intenml (0, 1). This leads to an 
important definition. 


Definition of Uniform Convergence. The seines 

72 = 1 

defined in the interval (a, 6), is uniformly convergent in that interval 
if, for any e > 0, there exists a number N, independent of the value 
of X in (a, 6), such that 

|S(a;) - Sn(x)\ < €, 


for all values of n N. 
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It should be noted carefully that the concept of uniform 
convergence is connected inescapably with the interval of con- 
vergence. The reader wiU profit greatly by pro^dng that the 
series (68-3), which was shown to be nonuniformly convergent in 
the interval (0, 1), is uniformly convergent in the interval 1). 
In the latter interval the function Nix) is bounded [see (68-5)], 
so that one can specify a single number N depending on e only 
and not on the particular choice of x in the interval (34, 1). 

69. Geometric Interpretation of Uniform Convergence. A 
geometric interpretation of the uniform and nonuniform con- 



vergence of series may help to crystallize these important con- 
cepts. The graph of the partial sum Sn(a:) of the convergent 
00 

series Six) = may be called the nth approximation 

n = 1 

to the curve y = Six). 

If the series is uniformly convergent, then the statement that 

(69-1) \'rnix)\ = iS(a-) - Sn(x)\ < e, 

whenever n N and for all values of x in (a, 6), can be WTitten 
as follows: 

Six) — € < Snix) < Six) + €. 

It follows from these inequalities that the graphs of the approxi- 
mating functions y — Snix) for suflSciently large values of n 
can be made to lie between the graphs of y = Six) + e and 
y — Six) — € for all values of x in (a, 6) (Fig. 67). 

In the case of a nonuniformly convergent series it is impossible 
to enclose the approximating curves in a band of width 2e about 
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the graph oi y = S{x). To be sure, for any particular value of 
X, say X = xi, the graph of y = s„(x) can be made to lie arbi- 
trarily near y — S{x) in the neighborhood of that point, so 
that the inequality 

\S{xi) - Sn(Xi)l 



Fig. 68- 


In the specific examples of Sec. 68 the series (68-3) is of this 
second variety. The graph of S(x) is a straight line 

y = S{x) = 1, if 0 < a; < 1, 
and 

S{0) = 0. 


The approximating curves 


are shown for several values of n in Fig. 68. All of the approxi- 
mating curves pass through the origin and approach the line 
y = 1 asymptotically. For any fixed value of Xj say x = Xi, 
in the interval (0, I), it is possible to find a curve y = Sn{x) 
which will lie as close to y = S(xi) as desired; but it is ob\dous 
that one cannot enclose the approximating curves in a band 
of width 2e no matter how large a value of n is chosen. 
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The behavior of the series (6S-6) is vastly different (see Fig. 
69). The graph of ?/ = S{x) is the straight line y = x, and 
the graphs of 

y = sJx) = -I — I 

^ ^ ^ 1 + nx 

for sufficiently large n can be made to lie entirely mthin the 
strip bounded by the lines y = x ± e. 



The reader will find it instructive to examine carefully the 
series 


(69-2) 


for which 



x 


1 + 2V 


) 


^n(x^ — 




Hence, S{x) = 0, which is a continuous function for all values 
of X. The graph of ^ = S{x) is the entire a:-axis, y = 0. The 
graphs of y = Sn{x) for n = 3, 5, 10 are indicated in Fig. 70. 
The approximating curves have peaks in the neighborhood of 
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X = 0 which grow higher mth increasing n. Since y = Sn(x) 
cannot be made to lie within the strip bounded by the lines 
y = ±€, it is clear that the convergence cannot be uniform. 
However, if the study of the series is confined to any interval 
which does not include x = 0, say 0 < 5 < rr < 1, the series will 
be found to converge uniformly to the value S(x) = 0. 

This illustration shows that the sum S(z) of the series may 
very well be a continuous function even when the series represent- 



ing the function is not uniformly convergent. However, a 
discontinuous function cannot be represented by a uniformly 
convergent series of continuous functions in the neighborhood 
of the point of discontinuity (see Sec. 70). 

PROBLEMS 

1. Show that 
1 


for which s^Ca:) = 
0 ^x<l. 


± 

X + n 


is uniformly convergent in the interval 
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2 . Show that the coavergence of 

1 X X- + + ' • • +*;”+■ ■ • 

is not uniform in the inter\'al (0, 1), but is uniform in the interval 

lo®* € “}~* loff fl — x') 

(0> M)- Prove that if |?*ri(a:)| < €, then n> ^ ^ 1. 

3. Show that 

(1 — rc) •+ x{l — a:) + rr2(l — a;) + . • . 

is not uniformly convergent in the interval 0 < a; ^ 1. 

4 Discuss the nature of the convergence of the series 

nx (n — l)x \ 

1 + 1 + (ti - l )- x -/' 

Yix 

for which sJx) , , , „ Show that S(x) is continuous but that 

1 + n^x- 

convergence is not uniform in any interval containing the point a; = 0. 

70. Properties of Uniformly Convergent Series. In formulat- 
ing the definition of uniform convergence, no assumption was 
made regarding the continuity of the terms of the series. It 
will be assumed in this section that the functions Un(x) entering 

OQ 

in ^Un{x) are continuous functions of x in some interval (a, b), 

n~l 

It is clear that the partial sums Sn(x), being the sums of a finite 
number of continuous functions Ui{x), will be continuous. 
However, the sum S(x) of an infinite series of continuous func- 
tions need not be continuous. This fact is e\ddent from the 
discussion in the preceding section in connection with the series 
(68-3). The question naturally arises: Under what circum- 
stances wall a series of continuous functions define a continuous 
function? An answ^er to this question is given by the following 
theorem: 

Theorem 1. Let 


%^{x) -f- Un{x) + 

fee a series such that each Un{x) is a continuous junction of x in 
the interval (a, 6). If the series is uniformly convergent in (a, fe), 
then the sum of the series is also a continuous function of x in 
(a, b). 
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Denote the sum of the series by S(x)‘, then it is required to 
show that* for any value of x, say x = xi, in the interval (a, b), 

|-S(xi + A) - 5(x0: < 
whenever |A| < 5. Now 

!-S(xi + — A) — s„(xi + A)] 

- h) - s„( 

Since the absolute value of the sum is not greater than the sum of 
the absolute values, one can write 

(70-1) A) - Sixr)\ 3(xi + A) - s„( A); 

h) — s,i(si)| -f- 

But, by h3q)othesis, the given series is uniformly con- 

vergent, so that for any prescribed e > 0 one can find a number 
N such that 

(70-2) |s„(x) — £I(x)| < whenever n ^ N, 

and (70-2) must be satisfied for any value of x in the interv^al 
(a, b). In particular, it must be true for x = Xi and for x = xi + h, 
so that 


(70-3) 

;Sn(Xi — S(,X1 -f A)| < g- 

Having chosen N so that the inequalities (70-3) are satisfied, 
choose a number 8 so small that for a fixed n > N 

(70-4) |s„(xi H- A) — s„ < whenever < 5. 

This is always possible since s„(x) is a continuous function. 
Substituting in the right-hand member of (70-1) gives 

l'S(xi h) — if |Al 


* See Sec. 11. 
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But this is precisely the statement required for the proof of the 
theorem. 

It should be noted that the conditions of Theorem 1 are 
sufficient to ensure continuity. A nonuniformly convergent 
series may converge to a continuous function [see the series 
(69>2)]. 

Theorem 2. If a series of continuous functions 
Ul{x) + Uoix) -!-•**+ Unix) 
converges uniformly to Six) in a < x < b, then 

Six) dx — J^uiix) dx + /> o(x) dx + ‘ ‘ dx 

+ * • • , 

where a ^ a ^ b and a ^ b. 

This theorem gives a sufficient condition for the integration 
of a series of functions term by term. 

By hypothesis the series '^Unix) is uniformly convergent in 

n ~ 1 

the interval (a, h) so that for any « > 0, 

(70-5) lr„(a;)| = lS(a:) — s„(a:)l < e, for n > N, 

and for every x in (a, 6). S{x) and Sn{x) denote, as usual, the 
sum of the series and the nth partial sum. It follows from 
Theorem 1 that S{x) is continuous, and hence it is integrable in 
(a, b). Therefore, 

(70-6) ~ ~ 

where a and (3 are any two values of x in (a, b). 

From (70-5) it is seen that 

dx —a) — a), 

and, since 


(70-6) gives 

(70-7) ~ ^ ~ n> N. 
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The inequality (70-7) states that the difference between the 
integral of the sum of the series and the integral of anv partial 
sum Sn{x) can be made arbitrarily small, protided that n > X. 
But 


dx = Ui{x) dx 


so that (70-7) becomes 

\£s(x)dx- ^f%,(x)dx 

1 i = 1 

This inequality, however, states that 

so 

(70-8) fJS(x) dx = %£ui{x) dx. 


< €(b — a), for 71 > K. 


If the limit /3 in (70-8) is set equal to x, where a x < b, 
then the series of integrals 

dx + dx + • • • + JJun(x) dx + ^ ‘ • 

converges uniformly to 


J'^Six) dx. 

A nonuniformly convergent series, vrhen integrated term 
by term, may or may not converge to the integral of the function 
defined by the series. For example, the series (68-3) was showm 
to be nonuniformly convergent in the interval 0 < a: :< 1. But 

dx = dx = 1. 

The nth partial sum of (68-3) w'as found to be 

1 

nx 


Sn{x) — 1 
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and 

s„(a:) dx = I ( 1 ^ ) dx 

0 Jo \ 71X + 1 / 

j _ log (n + 10 

Hence, 

lira r s„(x) dx = lim 

n— » 00 tJ 0 n-->' 00 \ 71 / 

SO that in this case 

' dx = dx = 1, 

despite the fact that the given series does not converge uni- 
formly. It is evident from this example that the condition 
enunciated in Theorem 2 is sufficient, but not necessary, for 
integration term by term. 

As an example of a nonuniformly convergent series that 

cannot be integrated term by term, consider the series 

in the interval 0 < rc < 1 whose nth partial sum Sn{x) is given 
by the formula 

= nxe~^^\ 

In this case the sum S{x) of the series is 

S{x) = lim nxe-^^" = 0. 

n —^ 00 

Consequently, 

£^S{x) dx = 0, 

whereas 
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fi . fi 1 

I Unix) dx = lim SrXx) dx = lim — 

t/ 0 n— * <=o J 0 n— > « 

71 = 1 


The fact that the series whose 7zth partial sum is 

n = 1 

Sr.(x) = cannot be uniformly convergent can be seen 



from the graphs of the partial sums y = Sn{x) plotted for several 
values of n in Fig. 71. The peaks of the approximating curves 
y = Snix) grow higher and higher* vdth the increase in n, and 
since SXx) = 0; it is ob\dous that it is impossible to draw a 
band of width 2e about S{x) that vdll enclose all the approxi- 
mating curves y = Sn{x) from some value of n onward. 

Theorem 3* If the series 


' The reader will have no difficulty in showing that the maximuiti value of 
Sn(x) occurs when x — so that (Sn(in))max, = 
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is convergent to Six) in {a, 6), and if the derivative of each 
is continuous in (a, h) and the series of derivatives 

ui(x) + uiix) + * • • + u'^ix) + * • • 

is uniformly convergent in {a, h), then the series of derivatives 
converges to S\x). 

Denote the sum of the series of derivatives by fix). Then, 
since the series of derivatives is assumed to be uniformly con- 
vergent in (a, 6), Theorem 2 permits this series to be integrated 
term by term so that 


where a and x are in the interval (a, 6). Hence, 

^Jy(a:) dx = ^[S{x) - ;S(a)] = 5'(x). 

But/(x) is a continuous function, and therefore,* 

fix) = S'ix). 

This theorem pro%'ides only sufiEicient conditions for the 
differentiation of a series term by term. It is possible to prove 
the theorem under less severe restrictions. In particular, the 
requirement that the K(x) be continuous is more severe than 
it need be.f 

71. Weierstrass Test for Uniform Convergence. The impor- 
tance of the concept of uniform convergence is amply illustrated 
by the theorems of the preceding section, and it is natural to 
inquire under what circumstances a given series converges 
uniformly. A direct application of the definition of uniform 
convergence, leading to the determination of the functional 
dependence of N upon x and e, is likely to be exceedingly difficult, 
since it requires knowledge of the expression for the remainder 
of the series. There are numerous tests, of varying degrees 

* See Sec. 38. 

t See KnopPj K., Theory and Application of Infinite Series, p. 342. 
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01 complexity, but the simplest of these is the test due to K. 

eierstrutoS, t\ hich is commonly known us the TT ^z^Tsirass 

M-test. 

Theorem (Weierstrass Test). Let 

uz(x) + Ui(x) 4- • - . + . 

be a series of functions such that each Ui{x) is a hounded function 
oj X in (u, 6). If there exists a convergent series of positive constants 

+ • • • + Mn + • • • 

such that \ui(x)\ ^ Mi for all values of x in (o, h), then the series 

Ul(x) + ^ 2 ( 2 :) + • • • + Unix) + • • • 

is uniformly and absolutely convergent in (a, b). 

In order to establish the theorem note that the series of M’s 
is convergent, so that 

Mn+l + Mn+2 + • • • + Mn-up < € 

whenever n > N, and for all positive integers p. But each 
mix) is such that |ui(a:)l :S Mi for all values of x in (a, b); hence, 

(71-1) |Mn+i(a;)l + ju„j. 2 ( 2 :)i -!-•••-{- |Un+p(rc)i < e. 

Since (71-1) is independent of the value of x in the interval 

eo 

ia, b), the series '^mix) is uniformly and absolutely convergent. 

i = l 

It should be noted that the concepts of uniform and absolute 
convergence are entirely distinct and that they do not imply 
one another. The series may be uniformly convergent, but 
not absolutely convergent, and \dce versa. 

ExampUs. Consider the series 


sin X sin 2x 
12 ^ 


+ 


sm nx 


+ 


Since |sin nx\ 1, the convergent series 


1 o 


+ ^2 + 


vdll serve as an Jlf series for the given series. Therefore, the 
given series converges uniformly in any interval (a, b), however 
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large. From Theorem 1, Sec. 70, it follows that the series 

^smnx ^ continuous function Six). Such a series 

may be integrated term by term in any interval to obtain the 
integral of Six). But the series of derivatives 

cos X cos 2x cos nx 

-J- + n 

is not uniformly convergent. In fact, * it is not even convergent 
for X = 2fcv, where fc = 0, 1, 2, • • • . 

On the other hand, the series 


71 = 1 

upon differentiation term by term gives 


The latter series is obviously uniformly convergent so that the 
differentiation is legitimate and one is assured that 


72. Abel’s Test for Uniform Convergence. The test of Weier- 
strass possesses the advantage of great simplicity, but it is 
applicable only to a restricted class of uniformly convergent 
series, since every series to which the Weierstrass test is appli- 
cable’ is necessarily absolutely convergent.^ A more delicate 
test, essentially due to Abel, is of great practical and theoretical 
importance, especially in the study of power series. 


Theorem (Abel’s Test). The series of functions ^u^ix) con- 

n = l 

verges uniformly in the interval a x b if the functions u^ix) are 


* This series, however, converges to -log 

See Prob. 6, Sec. 105. 



in the interval 0 <x <7r. 
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of the form Unix) = Onfnix), where the constants an are such that 
the series is convergent and the functions f^ix) are bounded 

n = 1 

a?id 'positive and satisfy the condition* 

fr.Ux) ^ fnix) < M, 

for every n and every value of x in (a, b) 

Let 

s„ = cti + Qo -j- 

®3> Sn — flji-t-l "f* OnJ-r, 


Sn+p S„ Un+1 + Un+n + - - - + 

> ~T~ ^n-fp/n-fjp. 

Noting that 

^m—1 if W ^ Ij 

Si == Qn-i-l, 

one can write 

|/Si„+p — (S„[ = lan-i-lfn+l + a„+5f„^2 + • • • + On+pfn+pl 

= jsj/n+i + (4 - s{)f„+i 4- • ■ • + (s' _ s;_i)/„+p| 
~ , ®2(/n+2 — /n+s) 4- • • • + S^n+pl 

^ l®ll(/n+l~/n+2) + [S2l(/n+2— /n+3)+ ’ ' ’ +iSpj/;^i.p. 

Denote the greatest of the numbers Is 'I, hn = 1 o 
by k; then ’ ’ ’ 

(72-1) ^ klifn^^ _ ^ . 

“i“ /n-f- 2 >] = kfn^i. 

00 

The series of constants "^an is convergent; hence, for any 

n = l 

€ > 0 one can find a positive integer N such that for all n > N 
and for every positive integer m, 

|Sn+m — Sni = |s^| < 


* The proof goes through with ob\fious minor changes if the sequence of 
positive functions /n(x) is monotone increasing with n. 
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In particular, the inequality is true for the greatest of the 
and it follows that 


*=<F 

Substituting this value of I in (72-1) and recalling that |/ „+il < M, 
gives 

ISn+j. - Sn\ < €, for aU n > N. 

CO 

But N is independent of x, and therefore, '^Un{x) is uniformly 
convergent. 




PROBLEMS 

1, Test the following series for uniform convergence: 

(а) 1 -h a; cos a + x- cos 2a! + cos 3a: -f • • • , |a:l 

(б) lOx -h -h 10^x3 

, sin x , sin 3a: sin 5a; 

(c) + -wv- + w 

(i) i cos 2 a: - i cos 3a: -h ^ cos 4a: - • • • ; 

, , cos 2a: , cos ix cos 6a: 

(e) -T— ^ + -w-wr- + — -- -r 


< 1 ; 


(f) 


1-3 

X 


+ 


3-5 
l/ a; 


5 • 7 


a: - 1 ' 2Va: - 1/ ' SVa: - 1 

(g) I - x + x^ - x^ + ^ 


+ 


.1.+ . . • ■ 
4^ 


/y»2 /y»3 

(^)--2 + 3 

x^ 

(i) 1 + a: -1- ^ -h ^ + • 


0) 


1 ifx-lV , ifx-l 

1 o 


+ 


a: 4- 1 ‘ 3\a: + 1/ 5\a: 4- 1/ 

2. Test the series of derivatives of Prob. 1 for uniform convergence. 
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73. Power Series. The series of the form 

= ao + aix + a^x- -{■•■■+ + • • • , 

n=0 

in which the coefficients of the powers of z are independent of 
X, occupy an especially prominent place in analysis and are known 
as 'power series. The totality of values of x for which a power 
series is convergent is called the interval of convergence of the 
series. 

It is readily verified, with the aid of the ratio test, that the 
series 


1 + a: + a;2 + • • • + A- • • • 


converges for all values of x such that !a:| < 1, and diverges 
whenever |a:| > 1, while the series 


1 + a: + Ij + 


+ 7r + 
nl 


converges for every real value of x. 

Obviously every power series converges for a; = 0, whatever 
the coefficients a„ are. The fact that some power series may 
not converge for any value of x other than zero can be seen 
from a consideration of the series 


l+x + 2\x^- + ■ ■ ■ -\-n\x^ + ' • ’ . 


The ratio of the {n + l)st to the wth term of this series is 

4 -. 

n\ z”- 
Un (n — 1) ! 

and since \nx\ increases with n for every x 0, the series diverges 
whenever |x| > 0. 
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The following fundamental theorem, due to Abel, furnishes 
information concerning the character of the convergence of 
power series. 

Theorem. If a power series ^ CnX^ is convergent for x = xo, 

n = 0 

then it is absolutely comergent for every value of x such that 
\x\ < |.Tol. On the other hand, if the series is divergent for x — x^, 
then it is divergent for every x such that [a;! > [xo\- 

cO 

Consider first a series ^ a^x^, which converges for some value 

of X, say x = xq. Then, necessarily, anXo — > 0 when n ■ 
so that there exists a positive number M such that 

|a„rrS| < ikf, for > 0. 

But 

|«-1 . 

and, for any x such that |a;| < \xq\, 

= r < 1. 

Accordingly, the series of absolute values, 

00 

\ar,x”‘\ = |aol + \aix\ + \azx‘^\ + • • • 

n = 0 

is term by term less than the convergent geometric series 

M + Mr + Mr^ +•■• + Mr^ + • ■ • , 

00 

and hence, the given series ^ anX'^ converges absolutely. 

n~0 

The proof of the second part of the theorem follows from 
the first part. Tor, assume that the given series diverges 
for X = xo, and suppose that it converges for some value of x 
such that \x\ > |2:o|. Then, by the first part of the theorem, 
the series must converge for x = Zo a& well, which contradicts 
the hypothesis. 
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It is possible to establish, with the aid of this theorem, the 

« 

existence of a number R such that ^ converges absolutely 

71=0 

for every x such that < R and diverges for all x such that 
!x| > R. However, instead of mei'ely establishing the existence 
of R, the actual determination of the value of R will be given 
in the next section. (This determination, of course, establishes 
the existence of R.) The number R is known as the 7'adhis of 
convergence of the series* and the interval {—R, R) is called the 
interval of convergence. 

74. Interval of Convergence. The theorem to be established 
in this section gives the exact determination of the radius of 

convergence of the power series It follows from the 

application of the root criterion of Cauchy, f that if 

(74-1) V^iar.|!x| ^ r < 1, 

then the series converges absoluteh' for all values of x 

n —0 

satisfying the inequality^ (74-1). In particular, if the limit of 
'^|a„| exists as n oc ^ and if its magnitude is L, then the series 

anX^ -v^iU converge for every x such that 

I 

(74-2) L\x\ < 1, 

and it will diverge whenever 

(74-3) L\x\ > 1. 

It follows from (74-2) and (74-3) that the radius of convergence 
R is given by the formula 

(74-4) R = l = 

L 

* The reason for associating with the number R the term radius of con- 
vergence is that the region of convergence of a power series where 2; is a com- 
plex number is a circle of radius R. 
t See Sec. 62 . 
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provided that L 9 ^ 0* But if L — 0, the inequality (74-2) is 
satisfied for all finite values of x, so that in this case the interval 
of convergence is infinite. If L == it follows from (74-3) 
that the series diverges for any x 9 ^ 0. Thus, if it is agreed, 

for the purposes of this section, to vTite i = co and = 0, 

then the formula (74-4) vill be applicable to all those series for 
which the limit L can be determined. 

As an illustration of the application of formula (74-4), consider 
the series 

(a) X + x^ + 

and 


i + i^ 


Since «« = 1 in (a), lim — 1, and the formula (74-4) 

71—4 eo 

gives J? = 1. In the case of the series (5), a^n = so that 
lim == Consequently, the radius of convergence of 

n— > 00 

(6) is 2. 

If one adds the series (a) and (6), there results the series 

(c) 

which certainly converges for all values of x such that \x\ < 1, 
However, the limit of '^\an\ as oo does not exist, since 
lim = }i and lim^'^[a^^ = 1. Formula (74-4) is 

rt— > « n—^ M 

not applicable in such a case, but it is recalled that every sequence 
of numbers has a uniquely defined upper limit, and it will be 
shown next that a generalization of formula (74-4) enables 
one to calculate the radius of convergence whenever (74-4) 
is not applicable. 

Theorem. Let L denote the upper limit of the sequence 

kil, V\a2\, , W 
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then the radius of convergence R of the series ^ is given by 
the formula 


n =0 


= ^ = 


1 


L lim V ;«ni 

Consider first the case where L = Q, so that R = If x 
is any fixed number not equal to zero, then 

2^>»' 

Z\X\ 


Since the upper limit L is zero, there are at most a finite number 

2[x\ 

one can find a positive integer p such that, for every n > p, 


of the ^\an\ that are greater than L + e = Consequently, 




or 




2 ^ 


Thus, the absolute values of the terms of the series ^ 

n = Q 

(for n > p) are less than the corresponding terms of the geometric 
00 

series since x can be chosen arbitrarily large, it follows 

71 = 0 

that the given series converges for all values of x. 

Consider next the case when L is finite but not equal to zero, 
and let x be any fixed number such that 

W < r 

Choose any number r between la:| and ji that is, 


ja:] < r < 


See Sec. 7. 
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then, - > L, so that - = L + e. Since only a finite number 

T T 

of the can exceed L + e, it follows that there must exist 

a positive integer p such that for every n > p 


or 


Thus, 


V\a4 < 


1 

—J 

r 




< 1. 



< 1. 


Again, the general term of the series ^ a„a;" (for w > p) is less 

n =.0 

in absolute value than the corresponding term of the convergent 
00 

Ixl’^ 

geometric series H * Consequently the given series must 


n — 0 

converge absolutely for every value of x satisfying the inequality 
[a:! < r. Since r can be chosen as near i as desired, the given 
series will converge for every x such that 


1^1 



A similar argument shows that if |a;| > then lan^c^l > 1, 
so that the series cannot converge for any x such that 





In the last possible case, namely, L — the terms of the 
given series are unbounded if x ^ 0, Consequently, the only 
value of X for which such a series converges is x = 0. 

In practice it is much easier to determine the radius of con- 
vergence with the aid of d’Alembert^s test. If the limit as 

n • of the ratio is defined, then it follows from d^Alem- 
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bert s test tbat tbe series ^ o.nX’^ will converge for those values 

n=0 

of X for which 

lira • ixj < 1. 

n— > oc I fliri ■ 

« 

Therefore, the given series ^’ih converge whenever 

n =0 


< 




and it will diverge when 


1^! > 


lim I 

n — * ce ■ Cln j 

1 


lim 


ian-fll 


n — > « ! Cf/j 


This permits the formulation of the following practical rule for 
the determination of the interval of convergence: 

05 

Rule* If the series ^ is such that 

n = 0 



n— »• 00 


= i2, 


then the series converges in the interval —R<.x<R. 

The discussion given above can be extended immediately 
to, cover series in powers of x — Xo, namely, 


(74-5) '^an{x — xaY. 

n = 0 

The substitution x' = x — xo in (74-5) gives the power series 

00 

n=0 

and if the latter series converges for all values of x' such that 
Ix'l < r, then the series (74-5) will converge for all values of x 
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such that \x - xo\ < r. Thus, the interval of convergence 
of the series (74-5) has the point a; = a:o as its midpoint. 
Examples. The interval of convergence of the series 

is inj&nite since 

lim — = lim = lim (n + 1) = . 

00 Cln+l n-» «» ^ ^ 

On the other hand, lim does not exist for the series 

n — »- 30 

i + ^ + (i) +^' + (i) + ■ ■ ■ • , 

However, the sequence 

|nii, -\/\o. 2 \, ■ ■ ■ , V^lanl, . . . 

is, for this series, 

1, Ij Mi • • • ) 

and it is clear that Im v^la„| = 1. Hence, the interval of 
convergence is — 1 < a; < 1. 
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(t) 1 + 




+ 


0) - + — a: 

a < 3 - 


b- 

:,2 ^ 3.3 ^ . . 


75. Properties of Functions Defined by Power Series. The 

so 

power series ^ whose radius of convergence is i?, converges 

for every value of x such that [xj < R and, hence, defines a 
function of x in the interior of the mter\"al (~i?, R). What 
can be said about the properties of functions defined by power 

1 — i i \ j — I — j 

-R -JCo CL O b Xo It 

Fig. 72. 

series? Will such functions be continuous? Is it permissible 
to integrate and differentiate power series term by term? And 
if so, w’hat can be said about the intervals of convergence of the 
resulting series? The answers to these questions furnish an 
explanation of the prominent role that power series play in 
analysis. 

Theorem 1. Let R > 0 be the radius of convergence of a power 

00 

series then this series converges absolutely and uniformly 

n = 0 

for every value of x in any interval a < x ^ b which is interior 
to the interval (— ’i?, R). 

Inasmuch as the interval (a, b) is assumed to lie entirely 
within the interval (—12, -R), one can choose a positive number xo 
that is greater than \a\ and but less than R (Fig. 72). Hence, 
the interval (a, b) lies entirely within the interval ( — Xo, Xo), 
so that for any value of x in the interval (a, b) 

la„x^| < |anX?l. 

Accordingly, the series of positive constants 


s 

ri-»C 
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can be used as the Weierstrass M-series to establish the absolute 

to 

and uniform convergence of the series ^ anX^ in the inter\^al 

n = 0 

(a, b). 

CO 

Theorem 2. A power series anX^ defines a continuous function 

n = 0 

for all values of x in any closed interval (a, h) which lies entirely 
within the interval of convergence of the given series. 

The truth of this statement follows from the preceding theorem 
upon recalling Theorem 1, Sec. 70. 

00 

Theorem 3. If the radius of convergence of the series ^ is 

n = 0 


jB, then the radii of convergence of the series 2) and 

n = 0 


■S 


n + 1 


obtained by differentiating and 


integrating the given 


n =*0 

series term by term, are also R. 

The proof of the theorem follows from the observation that 


hm v^anl = lim 


an 

n + 1 


= lim ->71^, 


n • ”/ i ' 

since both \/n and tend to unity as n increases indefi- 

nitely. 


Theorem 4. A power series ^anX^ may be differentiated and 

n = 0 

integrated term by term in any closed interval {a, b) which lies 
entirely within the interval of convergence of the given series. 

The validity of this theorem follows at once from Theorems 1 
and 3 of this section, upon noting Theorems 2 and 3, Sec. 70. 

76. Abel’s Theorem. None of the preceding theorems of this 
chapter furnishes information concerning the behavior of a 
power series at the end points of its interval of convergence. 

For example, the series 

(76-1) Si(x) = 1 X + + • •• ••• 
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converges for every value of x interior to the interv'al (-1, +1) 
and diverges at a: = +1. 

The series 


(76-2) = I' + +£!+... 

^ o n 

has the same intervml of convergence as (76-1), but it converges 
at a: = —1 and diverges when x = 1. 

The series obtained by differentiating (76-2) term by term 
is precisely the series (76-1), and the differentiation is legitimate 
so long as x lies in the interior of the interval (—1, 1). The 
series (76-1) defines a continuous function 


Si(x) 

for every value of x such that 
Since 



and 


1 

1 — a: 

< 1 . 

- log (1 





+ x + x^-\- • • • -1- a:” + • • ■ ) dx = X + ■ • • 


one can assert that 



Si{x) = - log (1 — x) 

so long as [a;] < 1. 

It is important to note that the series (76-1) represents the 
function 


S,(a) 


1 


1 — a: 


only for those values of x which are interior to the interv^al (—1,1), 
and it is not surprising that the equation 



= 1 X x^ -{• ••• -l-a:”-t- • • * 


gives a nonsensical result, if one substitutes in it formally a; = — 1. 
On the other hand, the series (76-2) converges not only for every 
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value of X interior to the interval ( — 1, +1), but for a: = —1 as 
well. Ill the interior of the interv^al ( — 1, +1) the series con- 
verges to 

(76-3) S 2 ix) = - log (1 - x), 

and the question arises whether formula (76-3) is valid for 
a; = — 1, so that one is permitted to write 

^ -1 + M - = “ log 2. 

A theorem, due to Abel, which vill be established next, answers 
this question in the adErmative. 

AbePs Theorem. If a power series whose radius of 

n = 0 

convergence R is finite, converges at x ^ R {or x —R) then it 
converges uniformly in the closed interval (0, R) {or (0, — i2)). 

There is no loss of generality in assuming that the radius 
of convergence of the given series is unity. For, a substitution of 
00 

X = Ry in the series GnX^, whose radius of convergence is R, 

71 = 0 

produces the series 

eo 

71 = 0 

00 

where bn = and the series ^ bn^^ converges in the interval 

n = 0 

(- 1 , 1 ). 

Assume that a; = 1 is an end point of the interval of conver- 
00 

gence of the series V UnX”, and that the series of constants 

71=0 

ao + ai + * + ctn “h • • • 

is convergent. 

The function fn{x) ^ x^ satisfies the conditions of AbePs test 

00 

(Sec. 72) in the interval (0, 1); hence, the series ^ UnX^ converges 

n = 0 

uniformly in the interval 0 a; ^ 1. 
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The proof of the case when the series converges at x = *-1 
follows from the foregoing if x in the given series is replaced by 

— X, 

The theorem of Abel states that if the given pow^er series is 
knovm to be convergent at one of the end points of the interval, 
then the interval of uniform convergence of this series can be 
extended to include that end point. Since a series of continuous 
functions that converges uniformly in a given inter\^al defines 
a continuous function in that interval, it follows that the series 

GnX^j which converges &tx = i?, defines a continuous function 

S(x) in the interval —R<x<R. Furthermore, since S(x) 
is continuous Et x = R, it follows that 

lim S(x) = SiR) = VanR\ 

n = 0 

In the example (76-2) it was found that the series 

converges for X = —I. Moreover, in the interval —1 < x < 1, 
S{x) = ~ log (1 - x), 
and the theorem of Abel shows that 

lim S{x) = lim [- log (1 - x)] = - log 2. 

— 1 x—^ — 1 

But 

lim S(x) = (S(— 1) = —I + +''' ■ 

x->-l 

Hence, 

— log2=— 1 + /4~ 

77. Uniqueness Theorem on Power Series. 

00 « 

Theorem. If the power series ^ and ^ both converge 

in some interval about the point x = 0 and have the same sum 
for every value of x in this interval, then the two series are identical. 
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By hypotliesis 

(77-1) a-o + aix + * + anX^ • 

= 5o + + + + hnX'^ + 

for all values of x in some interval ( — r), and since the function 

f{x) defined by these series is continuous for every point interior 
to (— r, r), it is certainly continuous at a; = 0. 

Letting —> 0 in (77-1), there results 


Dropping ao and 6o in (77-1) and dhdding through by x gives, 
for a: 7=^ 0, 

(77-2) ai + a^x -}- dzx’^ + * * * = 61 + i^x + hzX“ + * * * , 
Letting a; — » 0 in (77-2), there results 


a2 + dzx -|- a4,x^ + • • • = ^2 + + i^x'^ -f . . . ^ 

for X 9 ^ Q. 

A continuation of this process leads to the equality 

Un “ 

for every value of n. 

This theorem asserts that one can equate the corresponding 
coeiBScients of powers of x on both sides of the Eq. (77-1). Fre- 
quently, this theorem is called the uniqueness theorem on power 
series because it shows that there is not more than one way of 
representing a given function f(x) in an infinite series of powers 
of a; in a given interval. For, if two different methods lead to 
two power-series representations of a given function, then the 
two series are necessarily identical. 

78. Algebra of Power Series. It was shown above that a 
00 

power series ^ dnX^ converges absolutely for every value of x 

that lies within its interval of convergence. Consequently, 
it is permissible to rearrange the terms of the power series in 
any desired manner, so long as x is interior to the interval of 
convergence. 
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The follomng theorems merely restate Property (D) of Sec. 61, 
and Theorem 2, Sec. 66, in a form applicable to power series. 

Theorem 1. If '^ar,x’‘ and ^bnX’^ are two convergent power 

n=0 n=0 

series defining, respectively, the functiotis fi{x) and fi{x), then 
the series obtained by adding them term by term is the power series 

CO 

2) = (flo + bo) + (ai + bi)x 

n =0 

+ (^2 + bf)x‘^ + • • • + (a„ + + • • • , 

which converges to fi{x) + foix) at least in the common interval of 
convergence of the two series. 

Example. 

!+*+»=+. .. 

and 

cos X = 1 - ^ + p - • • • . 

Hence, 

Y~r^ + cosa:; = l + l+ a; — + + + , 

and the result is, certainly, valid so long as — 1 < a; < 1. 
Theorem 2, The series obtained by multiplying the two con- 


vergent series ^ a„a;^ and bnX‘^, defining, respectively, the func- 


tions fi(x) and/ 2 (a;), and grouping the terms as for a finite product, 
is a power series 

aobo -j- Hr aJ)o^x H- ((Xo52 H" H” a 2 bo)x*^ . 

H- {CLobn + Ctibn~l + * * * + anbo)x^ + * ‘ ' 3 

which converges to fi{x) ‘ f%{x), at least in the common interval of 
convergence of the two original series. 

Example. 

1 -<1.1 — o I t 


1 — a; 


= 1 + X + x^ x^ + 


yy,2 /y*3 

6«=l+X + |j + |-,+ 
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and 

and the result is valid if \x\ < 1. 

The formulation of a theorem on division of power series 
is not so simple. Consider the reciprocal of the power series 



where a' ^ ~ and y = 

do 

n = l 

00 

For all values of a; for which the sum of the series is 

n*« 1 

numerically less than unity, so that 1^] < 1, 

(78-1) fix) =^(l+y + y^- + ■■■ + y’‘ +■■■ ) 

do 

= 

n=l n~l 

CO 

+ • • • + + • • • ]. 

71 = 1 

Therefore, the problem is reduced to one that involves mul- 
tiplication of power series. However, matters are not so simple 
here, because each term of the series (78-1) is itself an infinite 
series, and it is impossible to assert that the rearrangement 
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theorem (Sec. 66) established for the case of a single absolutely 
convergent series is still applicable. If the rearrangement is 
performed formally, there results a series in powers of x, say 

9C 

^ CnX”, and the question arises as to what connection, if any, 

n “0 

exists betw-een f{x) and the series so obtained. The reader will 
guess that the series (78-1) will converge for sufficiently small 

CO 

values of y, so that the expansion ^ c„x^ will converge to f{x) 

n = 0 

for small enough values of x. This surmise finds a justification 
in the following general theorem, the proof of which is omitted:* 

X) 

Theorems. Given the power series f{y) = where 

CO 

y = '^atx’‘; 


n = Q 


k = 0 


then the power series 


n = 0 k-0 

will certainly converge for every value of x for which the sum of 
00 

the series ^ \akX^\ is less than the radius of convergence of the series 


k ==0 




n = 0 


An important observation may be made in connection with 
this theorem. If the series for/(y) in powers of x is to converge, 

oc 

then the radius of convergence R of the series ^ hnV^ must be 

n = 0 

such that R > [aol If ao — 0, then/(^) surely can be expanded 
in a power series in x whenever R > 0. 

This observation may be clarified by considmitg an example 
in which the process of substitution of one infinite series into 
* See Knopp, K., Theory and Application of Infinite Series, p. 180. 
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another is legitimate, and another example in which it is not 
legitimate. 

Let it be required to obtain a series in powers of x for the func- 
tion ^ by substituting 

y = smx^x-^ + f^- • • • 

into the power series for namely, 

e.^l+y + t^ + t^+ .... 

The intervals of convergence of both of these series are infinite, 
so that 


gJ/ = gsin® = 1 + 

4“ 


+ 


V “ ^ / 

1 ( x^ . x^ V 

^!V F! 5! “ ' ' ' } 


... , x^ Zx^ 8x^ 

"* + * + 2 !-^- 5 r 


This result is valid. 

As another illustration, let it be required to obtain a power 
series in x for the function log (1 + e^). 

Setting 

(78-2) = + 

and noting that 

(78-3) log(l+,)^,-|V|^-|V---, 

gives upon formal substitution of (78-2) in the right-hand member 
of (78-3), the series 

(78^) + I + + ■ ■ ■ ^ - 1(^1 + I + + . . . ^ 

+ 5(^ + ‘' + ii+ ■ ■ •)' • 
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Denote the sum of the series (78-2) for any particular value of 
2 > 0 by r; then (78-4) can be written as 


r - lir"- H- }ir^ - -f ■ • ■ , 

which diverges since r is always greater than unity when x > 0. 
Accordingly, this method will not jield the expansion for 

f(x) = log (1 + e) 

in a power series in x. 


It follows from 


Theorem 3 that if the series 


y = ^an 2 “eon- 

n =0 


\ erg6s for all \ alu6s of x and the series converges for 

n =0 

all values of y, then the substitution of y in terms of x and the 


rearrangement leading to the series c^x^ are legitimate. 

n s=0 

PROBLEM 

Discuss the expansion of f{x) = ^ ^ ^ in powers of x by using 


1 -f 2/ 


= f - y + y° - + 


and 


7*2 7*3 

y = = l+x + ^ + - + - ■ ■ . 

79. Calculations Involving Power Series. It was established 

in the preceding section that if the radius of convergence R 
00 

of the series ^ anX^ is greater than zero, then one can di-vide by 

n = 0 

the pow-er series, provided that Oo 0. Moreover, the resulting 
expansion will be valid for sufficiently small values of x. Thus 


(79-1) 


0^0 


1 

a2X^ • anX"- 


— Co + CiX 


A practical scheme for determining the coeflBicients is outlined 
next. It follows from (79-1) that 
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+ aix + + anX” )(co + CiX 

C 2 X- - 

and an application of the uniqueness theorem on power series 
gives 


GoCo = Ij 

GqCi + GiCo = 0, 

CIQC 2 "T UiCi + UoCo = 0, 
clqCz 4“ CI 1 C 2 “h ct2Ci “f" asCo = 0, 


The first of these equations determines co, inasmuch as ao 7^ 0 
by h;^q)othesis. A substitution of this value of cq in terms 
of ao in the second of these equations yields Ci. Consequently, 
the coefficients Ci may be determined successively. 

As an example, consider the problem of calculating the recip- 
es 

which has more than illustrative 

n “ 1 

significance. Denote the quotient 

1 

1 4. ii -l_ 5_ j_ . . . _| ± 

^2! ^3!^ ^(n + 1)!^ 


2JS 

CnX^, where Cn = Then 


n = Q 


1+1 +E+ 
^ 2! ^ 3! ^ 


■ + 


(n + 1) ! 


+ 


Bo + 


1! 


! "^^2 «> I > n ^ 1 

and the equations for the determination of the Bn are 

Bo = 1, 


1 R -I- 1 n 

2^. r. U 

J:R [ ^ -^1 I 1 -^2 _ A 

31“ 2! 1! 1! 2! 


) 
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-Be 

n\ 


+ 


5x 


+ 


1 




(n - 1)! 1! in - 2)! 2! 


+ 


+ 




1! (n - 1)! 


= 0 , 


It is readily deduced from these equations that 

B\ = — -Bs = i/g, Bi = 0, Bi = —}io, 

Bs = 0, Be = M 2 , Bt = 0, Bg = — 130 , ' ' ' 

These numbers (or their absolute values) are called Bernoulli’s 
■numbers, and they play a prominent part in the theory of infinite 
series. * 

It may be remarked that 

1 

/y* /lr2 /y.Tl 

1 4- JI. 4. ±- 4. . . . J 1 L . . . 

^ ^ 2! ^ 3! ^ ^ (n + 1)! ' 

(1 + a: + Jj + • • • + + ■ • ■ ) - 1 

Hence, 


- 1 “* ^ ' nf 

n = 0 


A similar procedure may be employed in calculating the 
quotient 


Go + aix + a2X- + 


+ + * 


bo 4“ ^2^" 4” 


4“ Kx^ 4- 


= Co 


+ 


-b Cix 4- CoX- 

+ CnX^ 4- • 


where bo ^ 0. Clearing of fractions and equating the coeffi- 
cients of like powers of x gives 

no — boCo, 

Gi = boCi 4” biCo, 

(I 2 = boC2 4“ biCi 4" baCo, 


Gn = boCn 4“ biCft_-i 4” ’ * * 4" bnCo, 


* See Knopp, K., Theory and Application of Infinite Series, p. 183. 
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from which the coefficients d (with i = 0, 1, 2, * • • ) may be 
calculated successively. These coefficients are identical vdth 
those that would appear if one performed the di\dsion of the 
series by the ordinary rules for di\dsion of polynomials arranged 
in ascending powers of x. 


The calculation of the powers of an infinite series 


may be performed as follows. Let 


71 =0 


(ao + aix + • • * + = co + Cix 

+ • • * + CnX'^ 

Then, 

m log (do + -L . * . 4 - anX'^ +•••) = 

log (co + Cio; + • • • + dx^ +**•)• 

Calculating the derivative and clearing of fractions, one finds, 

m(ai + 2a2X + * * * + + • • * )(co + CiX 

+ • • • + CnX^ +••*) = (<^o + aia; +••• + anX'^ 

+ ‘ * • )(ci + 2c2a; + • • • + nCnX'^^^ +**•)• 

Equating the coefficients of like powers of x on both sides of 
this equation gives a system of equations for the determination 
of Cl, C 2 , • • • , c„, • • * in terms of co. Clearly co = so 
that the coefficients d (where i = 1, 2, • • • ) can be determined 
successively^. 


PROBLEMS 

1. Show by squaring the series that 

= 1 + 2x + 3x^ + 
1 


2. n 


(1 - x)^ 


+ (71 + 1)X^ + 


and 


e»=l+^ + -+- + 


jy3 ywS 

sin. = .--j + - 


find the power series for e® sin x. 
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3. Show formally that if /lU) = and/;(a-) 


r.=0 


f , ( 

hk 9^ 0, then the quotient Vt-t of the form 

/sW 


X 

^ bnX^, where 

n=ik 


C-k . C - i^i , . . 

• • • -t- — -r Co + Cix -r cox- + • • • . 


4- Reversion of Series. If 

( 1 ) 2 / “ 2/0 = ai(x — Xo) + a2{x — Xq)- 4 - - ■ - 

converges for \x — a:oj < R, and if ai 0, the series may be solved for 
^ — ojo in terms of y — yo to give 

(2) X — xq = bi{y — yo) + b-iy ~ yo)- -f • • • . 


If y ^ V^ . is replaced by s, and a; — a;o is set equal to x\ the series (1) 
assumes the form 

(!') 2 = a[x' + a[x^- + • * • + a^x'^ + • * * , 


where a' = — > (n = 1, 2, • • • )? and (2) becomes 

Ui 

(2') a;' = b[z + + ' • • + 5> + • • • , 

where 

b'^ = bnd^. 

Substituting (2') in the right-hand member of (!') and equating the 
coefficients of like powders of 2, one obtains a set of equations for the 
determination of the coefficients 6'. 

Carry out the reversion of the series 


. x^ x^ 

y = snxx^x--+- 


to obtain 


1 y^ 

X = sm-i y ^ y + -J 


1 * 32/5 1 - 3 - 52/7 

2*45 ^2-4*67 


6. Use the procedure of Sec. 79 to calculate the first three terms of the 

series for — — ; to verify the expansion 
6=^ + 1 


e® -h 1 


^2(22 


i)i - - 1)4! - 


- 52„(22-> - 1). 


2j2n~l 


(2n)! 


+ 
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6. Find the first three terms of the series for sec x obtained by 
calculating 

1 ^ 1 

cos a: 1 _ I ^ . 

^ ~ 2!”' 4! 

7. Obtain the expansion for 

X X 


sin X x^ , x^ 


gx — g—X gx _j- g- 

8. Find the series for sinh x = — r — and cosh x s — - — 


with the aid of e"" = 1 + z + ^ + ^ + • • • . 

gx _ g’^x 

9. Find the expansion for tanh x = with the aid of 

6® “r 6 


e* = l + a: + -+- + - 


10. Assuming 


fix) = li| < 

71 = 0 


R, 


show by successive differentiations of f{x) that the coefScients an are 
of the form 


(Zn — 


/(»)( 0 ) 
nl ’ 


so that 


fix) = m + • • ■ + + 


This is the Maclaurin series. 



CHAPTEE IX 

APPLICATIONS OF POWER SERIES 


80. Extended Law of the Mean. It was shown in Sec. 20 that 
a function f{x) that is continuous in the closed interval (a, x) 
and possesses a derivative at every interior point of the inten'al 
can be written in the form 


fix) = /(a) + (x - c()/(t), 

where ? is some interior point of the interval (a, x). This 
result, known as the law of the mean, can be extended if the func- 
tion /(x) together vith its first n — 1 derivatives is continuous 
in the closed interval (a, b), and if its «th derivative exists at 
every interior point of (a, b). 

In order to obtain the extended law of the mean define the 
function F(x) by the equation 


Fix) ^ fib) - fix) - (6 - x)/'(x) - ^K^fix) 


jb - x)”~ 
in - 1)! 


./(n-l)(x) - 


2 ! 

jb - x)" r 
(b - a)"L' 


m-fia) 


(b - a)f'(a) - ^^f'ia) 


(b — a)"' 
(« - 1)! 


,-i 


./(»-« (a) 


which is so constructed that 


F(a) = F(b) = 0. 

The derivative of F (x) is readily found to be 
(80-1) F'ix) = 


(n 

n(b — x)”“1 




ib - a)- 


f{b) - /(o) - (jb - a)f'ia) 

(b - a) 


n-1 


(n ~ 1)1 


./(»-« (a) 


291 
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Since the function F(:c) satisfies the conditions of Rollers theorem, 
F^{x) must vanish for some value of say a: = interior to the 
interval (a, h). 

Setting X = (SO-1) gives 


(80-2) f(b) = f{a) -h (6 a)f(a) + • • * 


where a < ^ <b. Now, if b in (80-2) is set equal to x, one 
obtains the formula which expresses the function /(a*) as a 
polynomial of degree in rr — a, namely, 


(80-3) fix) = /(a.) + ix- a)r(a) + 


+ 


(x 




in -1)1 


+ 


jx — a)' 
nl 




where a < ^ < x. The coefficients of the powers of a: — a in 
(80-3), except the last one, are constants. The coefficient of 
(:r — a)'' is a function of which in turn depends upon the 
^magnitude of x. It may happen that this last term in the 
formula (80-3) is negligibly small in comparison with the preced- 
ing ones, and in such a case the function fix) can be approxi- 
mately represented by a polynomial of degree n — 1 in cr — a 
with constant coefficients. 

The formula (80-3) is known as Taylor’s formula, and its 
last term, 

(80-4) 


is called the Lagrangian form of the remainder after n terms. 

The foregoing derivation of the Taylor formula is not devoid 
of some artificiality, and the reader may have a feeling that the 
definition of the function Fix) anticipates the result. The 
follovdng section is devoted to a discussion of two simpler 
methods of derhdng formula (80-3), but the gain in simplicity 
there is achieved by imposing restrictions on the function fix), 
which are more severe than those required by the proof given 
above. It should be noted that the proof just given requires 
neither the continuity of the nth derivative in (a, b) nor its 
existence at the end points of the interval. 
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81. Taylor’s Formula. If the function /U*) is assumed to have 
a continuous nth derivative throughout the closed iriten^al 
(a, b), it is possible to give a simple derivation of Taylor's formula 
b}" integrating the 7ith derivative of the function n times in 
succession. Thus, if a; is any point of the interval (a, 6), then 


rx 


JO’ \o 

{dxY — j dx \ dx 

Ja Ja 

= ;(n- 2 )(j.) _/(n-=)(a) -{x- a)/f”-»(a), 


nx Px (*x 

/«(x) (da:)5 = 

Ja Ja Ja 


Ka) 



_ - a)Vc»- 

■^Ka), 

r-x 

/("Ka;) (dxy = 

fix) - f(a) - (x - a)f(a) 



{x — a) 

2! 


"(a). 

Solving for f(x) gives 



(81-1) fix) 

= fia) -h (a: - 

a)f(a) -h ^^^/"(a) 





■f Rn, 

where 




(81-2) 

Rn= r 
Ja 

• • • £f’^Kx)idx)\ 



It is easy to transform the integral form (81-2) of the remainder 
to the Lagrangian form (80-4) with the aid of the first mean-value 
theorem for integrals. * In fact, 


p/^Ca;) dx = {x — a)/'"’(?), where a < ^ < x. 

Jd 

Integrating both members of this equation n — 1 times, between 
the limits a and x, gives 


* See Sec. 37. 
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which is the Lagrangian form (80-4) of the remainder. 

Another proof of Taylor's formula, which leads to an extremely 
useful form of the remainder Rn, depends on the integration by 
parts of the ob^dous identity 

(81-3) f(a + h)- f(a) = + h - t) dt, 

where the prime over / denotes the derivative of the function 
with respect to its argument a + h — i. 

Integrating (81-3) by parts successively gives 


/(a + h) - f(a) 




f(a + h — t) dt 


if'{^ “b A — t) 


h rh 

+ I i 

0 Jo 


if '{a + h — t) dt 

h 


= ¥'(a)+fr(a + A-0| 


0 


+ + h-t)dt 


= hf(a) + +■■■+ 

Setting h == X — a, one obtains 

fix) = fia) + ix- a)/' (a) + . . . 

+ 

where 

(81-4) = (V^lJo* - t) dt- 

If the variable of integration in (81-4) be changed to X, which 
is defined by the relation \ = x - t, then (81-4) becomes 
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(81-5) 

In order to obtain the Lagrangian form of the remainder from 
(81-5). it is onlj' necessary to apply the first mean-value theorem 
for integrals.* Since a < \ < x, (x — X)"-! does not change 
sign in the interval of integration, and formula (37-3) gives 


where a < $ < a;. This establishes the identity of (81-5) with 
the Lagrangian form (80-4). 

A special form of Taylor’s formula, which results from setting 
a = 0 in (80-3), is known as the Maclaurin formula. It is 

(81-6) fix) = m -f xfiQ) -b |:/»(0) -b • • • 


where 


nl 

or 


The Lagrangian form of the remainder is frequently w’ritten 
in a slightly different form. Setting x — a h and recalling 
that a < ^ < Xj one can write 


where B is some number lying between 0 and 1. The number 
6, of course, depends upon the value of x. Consequently, 
the formula (80-3) can be written as follows: 

/(a -b A) = fia) -b f'ia)h 


where 0 < 0 < 1. 
*See Sec, 37. 
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82. Taylor’s Series. It was sho^Ti in Sec. 80 that Taylor’s 
formula, 


(82-1) f{x) = /(a) +f{a){x - a) 4- ' • • 


nn)(t\ 

n\ 


permits one to express a suitably restricted function f{x) as a 
pol}Tiomial of degree n in a; — a. The first n coefficients of 
the powers of rr “■ a in (82-1) are constants, whereas the coeffi- 
cient of (x — is a function of x, inasmuch as the magnitude 
of ^ depends upon the choice of x. 

It may happen that/(x) is of such a nature that the remainder 

Rn = — a)^ is bounded for all values of x in the interval 

nl 

(a, b), so that 


-(x - a)A 
nl ' 

where Mn is a bound which in general depends on both x and n. 
If the function f(x) has derivatives of all orders in the interval 
(a, 6), and if Rn tends to zero uniformly as to ^ in (a, x) as oo , 
t:hen the formula (82-1) can be written as the infinite series 

(82-2) f{x) = f{a) +f{a){x - a) - ay + 


which is known as Taylor^s series. A special case of Taylor’s 
series (82-2), obtained by setting a = 0, is known as Maclaurin’s 
series. It is 

(82-3) fix) = m 


The demand that Rnix) tend to zero uniformly with the 
increase of n is sufficient to deduce the infinite series representa- 
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tion (82-2) of the function f(x). Stated in precise form this 
requirement means that for each x in (a, h) and any e > 0, one 
can find a positive integer X, independent of the choice of J m 
(a, x), such that \RJx)\ < e for all n > N, 

It may happen that a formal application of the formula (82-2) 
^ill jdeld a series which does not represent the function \\dth 
the aid of which the series is generated. An example, due to 
Cauchy, may help to clarify this assertion. Let it be required to 
expand the function 


f(x) = e if x 9 ^ 0, 

= 0, if 


in Maclaurin’s series. Calculating the derivatives of f(x) gives 



1 



rix) = 


4 - 6:r- -_i 
— _ — e 


where P(rr) is a polynomial in x^ and p > 1. 

If the value of (a;) at a; = 0 is calculated,* it is found that 

/(O) =r(0) = * • • =/^«>(0) = . . ■ = 0. 

Therefore, the formula (82-3) gives 


which converges to zero for all values of a;, and hence fails to 

_JL 

represent the function e Moreover, if (p(x) is any function 
that can be represented by Maclaurin's series as 

?(^) = ^(0) - Of 


* See Sec. 14. 
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then the function 

1 

F{x) - <pix) + 6 

will have a Maclaurin expansion that is identical with that for 

1 

(p(x). The reason w^hy the function f{x) — e cannot be 
represented by a Maclaurin’s series is that the remainder, 

(0 < I < x), 


does not converge to zero for each rr in any interval including 
the point a; = 0, Of course, Taylor’s formula (82-1) can be 

1 

applied to give a representation of e and in this case the 
expansion about the origin reduces to a single term, which is 
precisely the remainder 

It follow^s from the uniqueness theorem on power series* 
that if any function can be represented by a powder series, then 
the coefficients in the power series must be identical with those 
appearing in the Taylor’s series representation of that function. 

83. Applications of Taylor’s Formula. 

(a) The Expansion of Sm x. Let it be required to expand the 
function f{x) = sin x in Maclaurin’s series. Now, 


f{x) == sin X, 
fix) = cos X, 
f'(x) = sinx, 
= —cos Xj 


m = 0 ; 

f (0) = 1; 

r(0) == 0; 
r'(0) = -1; 


— sin 


. ii/ji 

-j _ 


A substitution in the Maclaurin formula (81-6) gives 


and, since 
it follows that 


0 < f < 


* See Sec. 77, 
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where 9 is some positive number less than unity. Thus the 
remainder i2„ is 

(83-1) + t)‘ 

But the numerical value of sin x never exceeds unity, so that 

kn! 

( 

1 

for all values of x. Xow if x is confined to lie in the interval 
(—r, r), where r is an arbitrarily large positive number, then 

lim = 0 
\n\ 

for all values of x such that \x\ S r. Consequently, Rn(x) 
converges to zero uniformly in any finite interval (~r, r), and 
one is justified in writing 

“ ® 31 + 5 ! 

In order to illustrate the use of the remainder in estimating 
the magnitude of the error made in calculating the value of 
sin X with the aid of the infinite series, let it be required to 

compute the numerical value of sin Since 10° = radian, 

formula (83-1) gives 

Rn\ 

In particular, if = 9, the polynomial 

^ J 

3! 7!/ X 18 

gives the value of sin with an error that is 


jlYI 

18/ 7! 


less than 
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(6) The Expansion of e®. A procedure entirely analogous to 
that employed in the preceding example gives for e® an expansion 

- - - -r YI n- r , _ 1)[ ■ • 0 < 0 < 

A little reflection shows that for all values of x such that \x\ < r, 
where r is any positive number, 

lim 2^ . = 0. 

711 

Consequently, one can write 
(83-2) = 1 + ^ + 

For X = 1 this formula gives 

nl 

If the sum of the first n terms is taken as an approximate value 
of e, the error is less than 


since each term of this series is not less than the corresponding 
term of the series 


n\ ‘ (n+1)! ‘ (n + 2)! 

Thus for — 10, the error is less than 

and the value of e is easily found to be 2.718282 correct to six 
decimal places. 

If it is desired to obtain values of e® when 1 < a; < 2, then 
the power series in a: ~ 1 is more useful than (83-2). The 
expansion of f(x) in powers of a; — 1 is 
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- /(I) +/'(!) (a; - 1) +^-^{x -1)- + ■ ■ 


and, since 


(83-3) 


= e, (n = 0, 1, 2, • ■ ■ 
-f- - D- -f • ■ - 


The remainder in this case is 


so that the error made in using only four terms of the expansion 
(83-3) is 


^4 = - 1 )^ 


If a: = 1.1, then 


Since 1 < | < 1.1, and since is an increasing function, 
is certainly less than e^, so that Ri is certainly less than 


0.0001 


< 0.00003. 


(c) The Binomial Theorem. The fact that the binomial series 


(83-4) 1 + mx - 


nl 

converges for all values of x such that |a;| < 1 is readily established 
with the aid of the ratio test, but it is not so easy to prove that 
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the series (83-4) actually converges to the value of (1 + x)^ 
when m is not a positive integer. 

This section concludes with the discussion of the convergence 
of the expansion for the function 

f{x) == (1 + x)^. 

The derivatives of f(x) are found to be 
f(x) = m(l + x)^-\ 


= m(m — (m — n 

Substituting the values of these derivatives, calculated at a; = 0, 
in Maclaurin’s formula (81-6) pro\ddes the expansion 


(1 + a;)^ = 1 + mx 

— 1) _{m ^ n -1^2) 

Jn-W 

where Rn can be expressed either in the Lagrangian form (80-4) 
or in the form of the integral (81-5). 

It is more convenient to discuss the behavior of Rn by express- 
ing it in the form (81-5), so that 


(83-5) 


m(m— ■ 


(n~ 1)! 


It follows from the first mean-value theorem for integrals 
(Sec. 37) that 


(83-6) 


- X)--i d\ = 


where Q < ^ < x. 

The substitution of | = Ox, where 0 0 < 1, permits one to 

express (83-6) in a more convenient form, namely, 

^*(1 + - X)"-^ (iX = (1 + te)“-''(l - 0)”-^ 

/i _ 


(1 4 - 
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1-0 r^ 


If X is confined to the range -I < :r < 1, then the first bracket 
in (S3-7) tends to zero as n becomes infinite.* The second 
bracket, obAnously, does not exceed unity if \x\ < L and the 
last bracket is independent of n. Accordingly , 

lim i?n = 0 

n— > 00 

for all values of x in the closed interval (— r, r), where r is any 
positive number less than unity. Consequentlyj it is permissible 
to write 


(m 

'Td 

The ratio test shows that this series diverges if the numerical 
value of X is greater than 1, so that the series does not represent 
the function (1 + x)^ for \x\ > 1 unless ‘in is a positive integer. 
If X = ±1, the ratio test fails, and one must resort to more 
delicate tests to establish the behaidor of the series in this doubt- 
ful case. 

It follows directly from Kummer^s test (Sec. 63), upon setting 
Gn = n, thatf the series 


x)^" = 


2! 

7n{7n — 1 ) 


(a) 


converges absolutely if lim n 

n—i’ 00 



0 


> 1 , 


‘For, consider the sequence {an} whose general term an is equal to 
(m - 1) ■ • ■ (m - rt + 1) ' ’ 

(«-l)! ® ■ an III, ana 


it follows from the ratio test that the sequence {un} is a null sequence if 

W < 1. 

t This is known as Raahe^s test See also Prob. 6, Sec. 63. 



304 


ADVANCED CALCULUS 


and 


(jb) 


\un\ diverges if lim n 


< 1 . 


The general term Un of the binomial series is 
m{m — 1) * • • (m — n + 1 


Ur, == 


so that 


nl 

n + 1 1 


771 — nx 

Consider first the case when rr = — 1. Then 


Un n 

n — m 


so that 


lim n 


1 + m. 


It follows from (a) and (6) that the series 


converges if m > 0, 

and 

diverges if m < 0. 

If a; = 1, the series (83-4) becomes alternating if n > m + 1, 
so that the absolute value of the ratio of the nth term to the 
71 “I" 1 

(n + l)st is still — — The foregoing discussion shows that 
n 77h 

in this case the series converges absolutely so long as m > 0. 
If w < 0, the series of absolute values diverges, but the alter- 
nating series may converge conditionally. From the structure 
of the general term 

__ m(m — 1) • • (m — n + 1) 

“n! 

it is clear that if m ^ — 1, the successive terms do not decrease, 
so that the series diverges in this case. 

If m is between 0 and — 1, one may write the absolute value 
of Un in the following form: 


1^71! — (1 i 
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where a = 1 + m. It will be shown next that lim \Un, = 0, 

n~^ 00 

so that the series is convergent (since it is obvious that 


Xow 

(83-8) 


and, since 1 — ^ is less than unity, each term of the series 

(83-8) is negative. It is easy to show, with the aid of the integral 
test of Cauchy, that (83-8) diverges if > oc . Therefore, 

lim log j^^„| = — X. 

n—*’ » 

But if log |un| becomes negatively infinite as n ~» then |w»| 
itself must tend to zero. 

The results just obtained can be summarized as follows: 
The series (83-4) is convergent if ia;| < 1 and divergent if \x\ > 1. 
If a; = 1, convergence is absolute, if m > 0. 

If a; = 1, convergence is conditional, if — 1 < m < 0. 

If a; = 1, the series is divergent, when m < 

If a; = —1, convergence is absolute if m > 0. 

If a: = —1, the series is divergent when m < 0. 

It follows immediately from AbeFs theorem on the continuity 
of power series (Sec. 76) that if the binomial series converges 
for a; = 1, then its sum is precisely equal to 2^. If a; = — 1 and 
m > 0, then the sum of the series (83-4) is necessarily zero. 

PROBLEMS 

1. Verify the following expansions: 

L 4. _ 

2 ! 4 ! 61 


/ ^ 2 1 01^^ 

(c) =l-a;» + ^- 3 j + |l 


(d) log (x-1) - Mix- 1)2 -1- Msix - 1)3 - • 
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X — 1 , ifx — 


[Hint: Set a; = i in 


62 


(ff) sec a; = 1+ - + . • ; 

Qi) sin-la: = a: + + + 

2 3 2-4 5 2-4-6 


2 3 *^ 2 - 4 ^ 


(Z) ^ = I + X + ^ + + ■ • • . 

2. Expand: 

(a) tan x in powers of a: — 

(fi) in powers of a; — 2; 

(c) sin X in powers of a; — 

6 

(d) 2 + X- — 3a;® + 7a;® in powers of a; — 1; 

(e) log X in powers of a; — 2. 


84. Euler’s Formulas and Hj^erbolic Functions. Two par- 
ticular linear combinations of exponential functions are of such 
frequent occurrence in mathematics that it has been found 
convenient to give them a special name. The expression 
+ 6- ■=') is called the hyperbolic cosine of x, and is denoted by 

. . cosh X = MCe" + 6“®). 

The derivative of cosh a: is equal to }i(e^ - e-^) and is called the 
hyperbolic sine of x. Thus, 

sinh X = 

These functions are named hyperbolic because they bear 
relations to the rectangular hyperbola x^ ~ that are 

very similar to those borne by the circular functions to the circle 
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2 :- + = a-. The formal analog}" between the circular and the 

hyperbolic functions is best exhibited by the table given later 
in this section. It will be recalled that the expansion in Mac- 
laiirin’s series for is 

(S4-1) e“ = l + w+|] + |-' + • • • , 

SO that 

(84-2) e- = l + x + ^^ + ^+ • • • 

and 

(84-3) e-^ = 1- x + ^ -^ + • • • . 

Subtracting (84-3) from (84-2) gives 

--«--4 + r, + S+-"> 

SO that 

(84-4) sinh x - - — ^ ^ 3 I ‘ * 

On the other hand, addition of (84-2) and (84-3) gives 

(84-5) cosh :r - ^ 1 + . 

Moreover, if it is assumed that (84-1) holds for complex numbers 
as well as for real numbers, then 

( 84 - 6 ) ... 

and. 

( 84 - 7 ) + + 

where i = V"—!. Adding (84-6) and (84-7) and simplifying 
shows that 

. , . -A x‘^ , x^ . \ 

e- -f 6- = 2^1 - -i- jj - -f- • • • j, 

which is recognized to be the series for cos x multiplied by 2. 
Thus, 
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(84-8) cos X = 

It is readily verified that subtraction of (84-7) from (84-6) leads 
to the formula 

pix 

(84-9) sin a; = 


By combining (84-8) vith (84-9) there result two interesting 
relations, 

cos a; + i sin a; = and cos x — i sin x = 

which are known as the Euler formulas. 

The following table exhibits the formal analogy that exists 
between the circular and hyperbolic functions; the relations 
that are given for hyperbolic functions can be established readily 
from the definitions for the hyperbolic sine and the hyperbolic 
cosine : 


Circular Functions 


Hyperbolic Functions 


sin a; == — — 


sinh X — 

cosh X = 4* e”*) 


tana; 


cot a; 




tan X 


tanha; = 
coth X = 

tann x 


3! 


+ 


5! 


sin® X + cos® a; = 1 
1 -h tan® X = sec® x 
sin 2a: = 2 sin a: cos x 
cos 2a: = cos® x — sin® x 
sin {x ± y) == sin a: cos y ± 

cos a; sin 2 / 

d sin X 

, cos X 

ax 

d cos X 

— ; — = —sm X 
dx 


d tan x 

— ; — ^ sec® X 

dx 


sinb X = X -\ 1 h’ * • 

3! 5! 


coslix = l +-+- 


+ • • • 


cosh® X — sinh® a: = 1 


1 — tanh® X — sech® x 
sinh 2a: — 2 sinh x cosh x 
cosh 2a; = cosh® x + sinh® x 
sinh {x ± y) = ^inh x cosh y 

± cosh x sinh y 


d smh X 

; = cosh a: 

dx 


d cosh X . _ 

== smh a; 

dx 

d tanh x 

; == sech® X 

dx 
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85. Integration of Power Series. It was shown in Sec. 75 that 
a power series converges uniformly for all values of x in any 
closed interval that is interior to the interval of convergence. 
Moreover, the series resulting from term-by-term differentiation 
and integration of a power series have the same intervals of con- 
vergence as the original series and will converge to the derivative 
and integral of the function represented by the given series so 
long as X is interior to the interval of convergence. These 
facts are of great use in obtaining the power-series expansions 
of functions defined by integrals. 

Thus, consider the integral 

Expanding the integrand in a power series in one obtains 
tan“^ X = — z- + — ) dz 



Inasmuch as the power series in the integrand is convergent for 
\z\ < 1, one is assured that the expansion for tan“^ x is con- 
vergent for \x\ < 1. The reader vill convince himself that the 
procedure employed here in deri\ing the power series for tan“^ 
is much simpler than that of calculating the successive derivatives 
of tan“^ X and appl;^dng the Maclaurin formula. The uniqueness 
theorem guarantees that the expansion obtained above for 
tan™^ X is precisely the Maclaurin expansion. 

Ob\dously, the series converges at the end points x = ±1 
of the interval. Since the series converges for a: = 1, it follows 
from Abel’s theorem (Sec. 76) that the series actually converges 

to the value tan“^ 1 = t' Thus, one arrives at the conclusion 

4 

that 


Consider another example, namely, 


log (1 + 
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log (1 + 



{I + 


) dz 


This expansion is valid for \x\ < 1. For x = —1, the series 
is divergent. For a; = 1, it converges, and it follows from AbePs 
theorem that its sum is log 2. 

PROBLEMS 

1. Show that the remainder in the expansion of log (1 + x) is 

z”- dz 

R.(x) = (-dJ^ 

2. Obtain the expansion 

dz 1x^,1- 3a;' 

^ = = +F:45 

and show that 

2 232-45 

3. Show that the remainder in the expansion of tan^^ a; in a power 
series in a: is 


and show that E„(l) -> 0 when n 

86. Evaluation of Definite Integrals. One of the important 
uses of infinite series is in the evaluation of some difficult integrals 
for which the indefinite integral cannot be found in closed form. 
Three interesting examples of this use of infinite series are given 
below’'. 

— Q—x 

The integral I - dx cannot be evaluated with the 

aid of the fundamental theorem since the indefinite integral 

cannot be obtained in closed form. The expansion for ? 

if obtained directly, would lead to an extremely complicated 
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expression for each derivative. The expansion is most easily 
obtained by using the separate expansions for e* and e" Thus, 

1 + ^ + |-i + ^, + ■ • ■ j 


and 

Hence 

- e- 


i: 


X 


g—ar — 1 ^ J_ 

^2! ^! ' 




+ iTTl + + 


3 - 3 ! ' 0-5! 

In order to evaluate the integral dx. recall that 


= 2 . 1145 . 


1 J_ 

e“ = l + u + ^ + ^ 


SO that 


Then 




sin- X , sin*" X 


2! 


3! 


4- 


"XX 

=€( 


. , . , sin- X , sin^ x , 

1 + sin a: + + 


2! 


3 ! 


dx 


, , . , sm- X , sin** X , 

1 + sm a: + — d ttt + 


2 ! ' 3 ! 

which can be evaluated vith the aid of the Wallis formula, 


) dx, 


I sin” xdx = I cos” 

Jo Jo 


X dx 


— 1) — 3) ■ • • 2 or 1 

n(n — 2) • • • 1 or 2 


■Of, 


where a = 1, if is odd; and a = if is even. 

Let it be required to evaluate the integral* 

* The integrand in this integral becomes discontinuous at x = 1, but it i? 
easy to establish the convergence of the integral (see Sec. 95). 
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=j: 


V(1 “ 


? where fc- < 1. 


A substitution of x = sin 6 reduces the integral to 
Jo -n/I — sin- d 


(1 — = 1 + ifc2 g^j^2 Q _|_ sin^ 

Consequently, 


K = l + 


ii=£sin' 


d dB 


/ l • 3 • • • (2n - 1)Y 
^ V 2 • 4 • • • 2?i y 


= ‘i- l + {t k^+ • ■ . + 


+ 


sin^” 0 dd 


1 - 3 • • • (2n - l),r 
2 • 4 • • • 2n 2' 


If k is near unity the convergence of the resulting series is not 
so rapid as may be desired. In such a case a substitution of 
P = 1 — k^ can be made, so that 

(1 - sin^ = -1-(1 + tan^ 6 )-^^ 
cos 6 ^ 

Expanding the right-hand member of this expression by the 
binomial theorem and integrating term by term gives a series 
that converges rapidly for small values of 1. 


PROBLEMS 

1 . Calculate cos 10°, and estimate the maximum error committed by 
neglecting terms after 
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2. Find tbe interval of convergence of the expansion of e- in power 
series in x. Determine the number of terms necessary to compute 
accurate to four decimal places from this expansion. 

3. Compute sin 33®, correct to four decimal places. 

4. Develop the power series for tan'^ x in powers of x, and find the 
interval of convergence. 


5. 


Expand the integrand of 



in power series in x, and inte- 


grate term by term. Compare the results with that of the preceding 
problem. 

6. Compute '\/^ = 2(1 + correct to five decimal places. 

7- Develop the power series in x for sin'^ x and hence establish that 


TT 

6 


2*2 3 \ 2 / 


1-3 1/1 
2*4‘5V2 


+ - • - . 


8. Differentiate term by term the power series in x for sin x and thus 
obtain the power series in x for cos x. What is the interval of conver- 
gence of the resulting series? 

9. Dmde the series 


sm X = X 

o 1 



by the series 


cos X = 1 — 


x2 

2! 4I 


and thus obtain the series for tan x, 

10. Differentiate the series for sin“^ x to obtain the expansion in powers 
of X for (1 — x-)"^. Find the interval of convergence. Is convergence 
absolute? Investigate the behavior of the series at the end points of the 
interval of convergence. 

11. The integrals 


dd 

FQo, ¥>) = ^1 _ s 

and 

E{k, <p) = J^^\/ 1 — sin^ 9 dd, 

where < 1, are called the elliptic integrals of the first and second hinds, 
respectively. Discuss the evaluation of these integrals. The numbers 
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^ V V ^ \ ’ V complete elliptic integrals and are 

denoted by the letters K and E, respectively. The values of the func- 
tions F(ib, tp) andE(/c, tp) are tabulated.* 

12. The major and minor axes of an elliptical arch are 200 ft. and 
50 ft., respectively. Find the length of the arch. Compute the length 
of the arch between the points where a; = 0 and x = 25. Make an 
estimate of the remainder. 

13. Show that 


r i dx ^ rl 

Jo Vsina: Jo 


dx 




= V2 


cos X 




d<p 


VT — H sin® (p 


Hint: Set v cos x — cos <p: 

14. Show that 


Jo v^l — sin® 6 ^ 


Hint: sin^ ^ ^ sin^ d). 

fC^ IC^ 

15. Show that 


K ^ 



dd 


- sin® e 



if ^2 < 1. 

16. Find the length of one arch of the sine curve. 

17. Find the length of the portion of y — sin x lying between a; = 1 
and a: = 2. 

18. Show that the length of arc of an ellipse of semiaxes a and h is 
given by 



where e is the eccentricity. 


* See, for example, Peirce’s A Short Table of Integrals. 
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Estimate the magnitude of the remainder after three terms. 
19. Evaluate in series: 


(«) 

(c) 

(e) 


{q) 



sin (a;-) dx] 


sm X , 
dx: 

X 

cos {xr) dx; 


cos x dx 
\/ x 


(b) 

id) 

if) 


cos x)~~'^ dx 


sin X dx ^ 

Jo Vl - s*’ 

jV 

(k) I etan a: dx, 

Jo 


20. Show, by squaring and adding the power series for sin x and 
cos X, that 


sin^ X + cos- a; == 1. 



87. Maxima and Minima of Functions of One Variable. A 

function /(a;) is said to have a maximum at a; = a, if 


and 


A+ = /(a -h A) - /(a) < 0, 
A“ = /(a — h) — /(a) < 0, 


for all sufficiently small positive values of h. If A-^ and A" are 
both positive for all small positive values of hj then f(x) is said 
to have a minimum a,t x = a. 
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It is shown in the elementary calculus that if the function 
f{x) has a derivative at a; = a, then the necessary condition for a 
maximum or a minimum is the vanishing of f{x) at the point 
X = a. Of course, the function f{x) may attain a maximum 
or a minimum at a: = a T\dthout ha\dng /'(a) = 0, but this can 
occur only if f{x) ceases to exist at the critical point (see Fig 
73). 

Let it be supposed that /(a:) has a continuous derivative of 
order n in some interval about the point x = a. Then it follows 
from Taylor^s formula that 


A^^fia + h) -~/(a) 

where 0 < < 1, and 

A- s /(a -h) - fia) 

- -rwh+i^h'- 




^ (w-i)r 
+ (-i).gl °J W i. 


where 0 < ^2 < 1. Let it be assumed further that the first 
n — 1 derivatives of f(x) vanish at a; = a, but that (a) is not 
zero. Then 


nl 

and 

4- = 

nl 

Since f^^^{x) is assumed to be continuous in some interval 
about the point a; = a, + dih) and — d^h) will 

have the same sign for sufficiently small values of A.* Con- 
sequently, the signs of A+ and A” vdll be opposite unless n is 
an even number. But iifix) is to have a maximum or a minimmTt 
at a; = a, then A+ and A“ must be of the same sign. Accordingly, 
the necessary condition for a maximum or a minimum of f{x) 


* See Theorem 3, Sec. 12. 
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at a; == a is that the first nonvanishing derivative of fix), at 
X = a, be of even order. Moreover, since both and A~ 
are negative if /(x) is a maximum, it follows that /''‘-(a) must be 
negative. A similar argument shows that, if fix) has a minimum 
at X = a, then the first nonvanishing derivative of fix) at x = a 
must be of even order and positive. 

If the first nonvanishing derivative of f{x) at x = a is of odd 
order, and /"(a) = 0, then the point x = a is called a point of 
inflection. 

Example. Investigate /(x) = x^ - 5x^ for maxima and 
minima. Now 

fix) = ox*^ — 20x^, 

If 

which is zero when x = 0 and x = 4. Then 

/"(x) = 20x3 - 60x^ /^(O) = 0, /"(4) = 320; 

/'^'(x) = eOx" - 120x, /"'(O) = 0; 

= I20x - 120, /^’(O) = - 120. 

Since/" (4) > 0, /(4) = —256 is a minimum; and since/^''(0) < 0, 
f(Q) = 0 is a maximum. 

PROBLEMS 

1. Examine for maxima and minima: 

(а) y — — 4x3 4~ 1; 

(б) y = x3(x — 5)2; 

(c) ^ = X + cos X. 

2. Find the minimum of the function y — x^, where x > 0. 

Hint: Consider the minimum of log y. Ans. x 

3. Show that x = 0 gives the minimum value of the function 

y = e~^ + 2 cos x. 

88. Taylor’s Formula for Functions of Several Variables. 

Let fix, y) be a function of twm variables x and y that is con- 
tinuous in the neighborhood of the point (a, 6), and that has 
continuous partial derivatives, up to and including those of order 
n, in the vicinity of this point. 

If a new independent variable t is introduced vdth the aid of 
the relations 



(88-1) 


X = a + oit, 


y = h + 0t, 
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■where a and jS are constants, there ■nill result a function of the 
single variable t, namely, 

(88-2) F(0 = fix, y) = /(a + at, b+ fit)- 

Expanding F {t) ■with the aid of the Maclaurin formula gives 

F"(0) F^’'H6t) 

(88-3) F(t) = F(0) -t- F'm -h -h 

where 0 < 0 < 1. 

It follows from (88-1) and (88-2) that* 

F'it) =Mx,y)^+fyix, y)^ 

= Uix, y)a -1- fyix, y)p. 

Calculating F"it) andE"'(0 from this expression gives 

F''ii) = \fU^, y)^ + fy^i^, 2/)^] ^ + UTyix, y)a + fyyix, 2/)j8] ^ 

= fxxix, y)a‘^ + 2f^yix, y)a^ + fyyix, y)^^, 
and 

F'"it) = Uxx.ix, y)a^ + 2fUx, y)ccp + fyy.ix, y^ ^ 

"h [fxxyix, y)a'“ -|- 2fxyyix, y')a^ fyyyix, y')P^] 

= fxxzix, y)a^ + Sfx^iXj y)a^P + 3fxyy{x, y)ap^ + 

fyyyi^i 

Higher order derivatives of F{t) can be obtained by con- 
tinuing this process, but the form is evident from those already 
obtained. Symbolically expressed, 


f"(,) = (4 + #|)ks) 


- 4 + 4 - 

dx dy 




= „.3 5^/ 




dxdy^-^ dy^ 


* See Sec. 24. 
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Then 


F- (0 - (aj-^ + 3-l^fix, y) 


= rJ_l 


dx’‘ 


Cla”-~-3 


5”/ 


dz^--^dy 


T C^._ia3’- 


where 


j. 

dxdij^-^ ‘ • dy^ 


r!(n — r)! 

Since t = 0 gives x == a and y == b, 

^(0) = /(a, &), F(0) = af,(a, b) + /3/^(a, 6), • • - . 

Substituting these expressions in (SS-3) gives 
F(.t) = f(x, y) = Ka, h) + [af,(a, b) + Pfy (a, b)]t 
+ [o^YUw i) + 2afiUXa, b) + /3=/»(a, 6)] ^ 

+ [a%xx(a,5) + Sa-ff:^(a,b) + 3ai3%^j,(a,6) + P%y^{a, 6)]U 
+ ■■■+£., 

where R. - ^ I/) 

Since at = x — a and fit = y — b, the expansion becomes 
(88-4) f{x, y) = /(a, 6) -f /,(a, b){x - a) + fy{a, b){y - b) 

+ ^\Uxx{a, b)(x — a)- -f- 2fxy(a, b) {x — a){%j — 6) 


"b i>)"] 

-f- ■ ■ ■ -r Rn- 

This is Taylor s expansion for a function f{x, y") about the point 
(a, b). Another useful form of (88-4) is obtained by replacing 
^ ® by h and y b by h, so that x = a -{• h and y = b h 

Then, 

(88-5) /(a -\-h,b -hk) = /(a, b) -f /^(a, b)h + fy(a, b)k 

+ ^pxx{a, b)hfi + 2j^{a, b)hk -f fyy{a, 6)&=] 

+ • ■ • + if?„, 

” ^ ^ ^ I)) ^ 


where R, 
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This formula is frequently written symbolically as 
f{a + h, b + k) = f(a, ^ ^ 

+ * * • + Rn. 

In particular, if the point (a, h) is (0, 0), the formula (88-4) 
reads 

(88-6) fix, y) = m 0) + UO, 0)x + fM 0)y 
+ 0)x^ + 2f^C 

+ • * ■ + Rnj 

where i2„ = ^ /(to, 6y), 0 < 0 < 1. 

This development is known as the Maclaurinformula for functions 
of two variables. It is seen from (88-6) that the Maelaurin 
formula expresses the function f{x, y) in a series each term of 
which is a homogeneous pol 3 momial in x and y. 

The procedure outlined above can be generalized easily to 
yield similar expansions for functions of more than twm variables. 

Example. Obtain the expansion of tan~^ - about (1, 1) up 

to the third-degree terms: 


/(a:, y) = 

tan~^ -} 

X 

/(I, 1) = tan“^ 1 

y) = 

y 

Mh 1) = 

x^ -b y^’ 

fy{x, y) = 

x 

fyih 1) = 

^2 _|_ yi’ 

S^xix, y) = 

2xy 

fxxO-, 1) = 2 ', 

(X^ + 2/2)2’ 

y) = 

y2 _ y.2 

fxy(^3 1) = 0^ 

(X^ + 2/2)2’ 

fyy(x, y) = 

-2xy 

fyy(lj 1) = -“ 2 * 

{x^ -f y^y’ 
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Then 

f = I “ - 1) + k(y ~ 1) 

2^ — Ij- — ^(i/ — 1)- + • • • , 

PROBLEMS 

1. Obtain the expansion for zy^ + cos xy about ^1, ^ up to the 
third-degree terms. 

2. Expand /(x, y) = at (1, 1), obtaining three terms. 

3. Expand e* cos y at (0, 0) up to the fourth-degree terms. 

4. Show that for small values of x and y 

€= sin y = y -{• xy (approx.), 

and 

c* log (1 4- 2/) ^ y ^ xy — J (approx.). 

6. Expand /(x . y) = x^y -f x^j + 1 about (0, 1). 

6. Expand -v/l --- x- ~ y- about (0, 0) up to the third-degree terms. 

7. Show that the development obtained in Prob. 6 is identical with 
the binomial expansion of [1 — (x- + y-)]'‘^, 

89. Maxima and Minima of Functions of Several Variables, 

A function /(x, y) of two independent variables is said to have a 
maximum at (a, h), if 

Af = fid + A, 6 + fc) •— fidj 6) < 0 

for all sufficiently small positive and negative values of h and k. 
It is said to attain a minimum at (a, h), if 

A/* = fid + h, b + k) — /(a, 6) > 0 

for all sufficiently small positive and negative values of h and k. 

Let it be assumed that /(x, y) attains a maximum (or a mini- 
mum) at (a, h). Then the function of a single variable /(x, h) 
must attain a maximum (or a minimum) at a, and its derivative, 
if it exists, must vanish at x = a. Hence, a necessary condition 
for a maximum (or a minimum) is that 


(89-1) 


^ = 0 at X = a, 
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pro^dded that this derivative exists. A similar consideration 
of the function /(a, y) leads to the conclusion that 

(89-2) = 0 at 2 / = 6 

dy 

whenever the derivative exists. 

The equations (89-1) and (89-2) may be solved for a and I 
to }deld the desired values. This discussion can be extended 
in an obvious way to include the case of functions of any number 
of independent variables, so that one can formulate a theorem. 
Theorem. A function of any nwinber of independent variableB 
^ 2 , ''' attains a maximum or a minimum only for those 
mines of the variables Xifor which 

£ ^ £ 

dXl dX2 ’ dXn 

either vanish simultaneously or cease to exist. 

In order to establish a criterion for distinguishing between a 
maximum and a minimum, note that Taylor’s formula gives 

(89-3) f{a + h,h + k) - /(a, 6) = fx{a, b)h + /y(a, 

+ 6)^^ + 2/®i/(a, b)hh + /j/y(a, 5)P] + 

where 

Since the vanishing of the first derivatives is a necessary condi- 
tion for a maximum or a minimum, (89-3) becomes 

(89-4) A/^/(a + /i,& + i)-/(a,5) 

= W + 2U{a, b)hk + fyy{a, b)¥] + R. 

From the definition of a maximum it follows that A/ < 0 for 
sujficiently small numerical values of h and k, whereas for a 
minimum it is necessary to demand that A/ > 0. 

In order to simplify the discussion of the determination of 
the sign of A/, introduce new independent variables by means 
of the relations 

A = r cos <pj 
fc = r sin (p. 
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(89-5) Af = ^(--l cos= V' + 


■ 2B sm 


where 

.4 = U(a, 6), 
B = f,/a, h). 
C = fAw h), 


and $ is a function that is bounded for sufficiently small values 
of r. 

If .4 9 ^ 0, (89-5) can be expressed in the more useful form 


(89-6) 


(.4 cos (p 


A 



Consider the following possible cases : 

(a) AC — B- > 0. in this case the sign of 


(89-7) 


(A cos ^ -}- 5 sin (p)- + (AC — B-) sin- tp 


is the same as the sign of A. But, since $ is a bounded function 

T 

for sufficiently small values of r, the numerical value of can 

be made as small as desired by choosing r sufficiently small. 
Accordingly, the sign of A/ will be determined b}^ that of A. 
It follows then that the point (a, 5) gives a maximum value of 
the function /(a;, 2 /) if A < 0, and a minimum value if A > 0. 

(&) A(7 — jB- < 0. The first term in the numerator of 
(89-7) vanishes if 

(89-8) tan ^ 

If ^ is one of the values satisf:^dng Eq. (89-8), then the 
numerator of (89-7) vdll be negative, and by choosing r sufficiently 
small, the first term in the bracket of (89-6) can be made to 
dominate the expression. Therefore, for ^ = ^ 1 , A/ will have 
the sign opposite to that of A. On the other hand, if = 0, 
the numerator of (89-7) is positive, and hence, for ^ = 0 and 
sufficiently small values of r the sign of A/ is the same as that of A. 
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It follows that A/ does not maintain the same sign in the neighbor- 
hood of the point (a, 6), and consequently, this case gives neither 
a maximum nor a minimum. 

(c) AC — jB“ = 0. If AC — 5^ vanishes, then the numerator 
of (89“7) is either positive or zero. Therefore, it is necessary 
to investigate the beha\dor of the function 4> in order to.be able 
to say anything about the sign of A/. Since the study of the 
function is‘ extremely involved and depends upon a very 
painstaking study of the higher derivatives of the function 
/(a:, y), it will not be pursued here.* 

There remains to be considered the ease when A = 0. But a 
reference to (89-5) shows that, since 

2B sin (p cos p + C sin- <p 

vanishes for some values of (p, this case also leads to the investiga- 
tion of the function 

It is clear from the foregoing discussion that a maximum or a 
minimum will surely obtain if — AC <0, that is, if 


D ^ 


i dY 

dx dy 


—L 'LL 
dy^ 


< 0 . 


• dH dH 

case in which both and 

ox^ dy- 

are negative, and a minimum to 

the case in which they are both 

positive. 

Example 1. A long piece of 
tin 12 in. wide is made into a 
trough by bending up the sides 
to form equal angles with the 
base (Fig. 74), Find the amount to be bent up and the angle 
of inclination of the sides that will make the carrying capacity 
a maximum. 

The volume will be a maximum if the area of the trapezoidal 
cross section is a maximum. The area is 


A maximum corresponds to the 



t< 12- 2x >1 

Fig. 74. 


A = sin ^ “ 2x^ sin 6 + x^ sin 6 cos <9, 


* See Goursat, C. Cours d^analyse mathematique, vol. 1, 5th ed., pp. 
110-115. 
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since 12 — 2x is the lower base, 12 ~ 20 * + 2x cos Q is the upper 
base, and x sin d is the altitude. Then, 

= 12,r cos S ~ 2x- cos 0 + X' cos- B — x- sin- 
= x(12 cos ^ — cos ^ + x cos- B — X sin- 

and 

^ = 2 sin ^(6 — 2x ^ cos 

Q Al CJ.ri . . 

* = 0 and = 0, if sin ^ = 0 and x = 0, which, from physical 

considerations, cannot give a maximum. 

There remain to be satisfied 


6 — 20 * + x cos ^ = 0 

and 

12 cos 6 — 2:r cos ^ + o: cos- 6 — x sin- 0 = 0. 

Solving the first equation for x and substituting in the second 
yields, upon simplification, 

cos 0 = or 0 = 60°, and x = i. 

Since physical considerations show that a maximum exists, 
a: = 4 and 0 = 60° must give the maximum carr 3 dng capacity. 
Example 2. Find the maxima and minima of the surface 

h = 2c0. 

a- £>- 

Now, 

dz _ I ^ ^ 

dx c a-^ dy 

which vanish when x = ?/ = 0- But 

dH _ ^ ^ 

dx- dy^ Vc 

Hence, D = and consequently, there is no maximum 

or minimum at x == y = 0. The surface under consideration is a 
saddle-shaped surface called a hyperbolic paraboloid, The points 


c 5- 


dx dy 


0 . 
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for which the first partial derivatives vanish and D > Q are 
called minimax. The reason for this odd name appears from a 
consideration of the shape of the h;^’perbolic paraboloid near the 
origin of the coordinate system. The reader will benefit from 
sketching it in the vicinity of (0, 0, 0). 

PROBLEMS 

1. Divide a into three parts such that their product is a maximum. 
Test by using the second derivative criterion. 

2. Find the volume of the largest rectangular parallelepiped that can 
be inscribed in the ellipsoid 

+ + = 
o2 ^ 62 ^ c" 

3. Find the dimensions of the largest rectangular parallelepiped which 
has three faces in the coordinate planes and one vertex in the plane 


a 0 c 


4. A pentagonal frame is composed of a rectangle surmounted by an 
isosceles triangle. What are the dimensions for maximum area of the 
pentagon if the perimeter is given as P? 

6. A floating anchorage is designed with a body in the form of a right- 
circular cylinder with equal ends which are right-circular cones. If the 
volume is given, find the dimensions giving the minimum surface area. 

6. Given n points Pi whose coordinates are (f= 1, 2, • • • ,n). 

Show that the coordinates of the point P(x, 2 ), such that the sum of 
the squares of the distances from P to the Pi is a minimum, are given by 

i=l i=l 1=1 

7. Let z = f{Xj y) be the equation of a surface which has a minimum at 
the point (0, 0). Then every plane containing the s-axis will intersect 
the surface in a curve which has a minimum at (0, 0). The converse of 
this statement is not true, as can be seen by examining the surface 

z = {y - 

in the neighborhood of the origin. Show that there exists no two- 
dimensional neighborhood of the point (0, 0) in which the values of this 
function are all of the same sign. 
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90. Constrained Maxima and Minima. In a large number of 
practical and theoretical inve.stigations it is rec[iiired that a 
maximum or niinimuni value of a function be found when the 
variables are connected by some relation. Tliiis, it may be 
required to find a maximum of u = /(x, y, 2 ), wdiere x, y, and 2 
are connected by the relation c(x, y, z) = 0. The resulting 
maximum is called a cojistrained maximum. 

The method of obtaining maxima and minima described in 
the preceding section can be used to solve a problem of con- 
strained maxima and minima as follows: If the constraining 
relation s?(x, y, 2 ) = 0 can be solved for one of the variables, 
say z, in terms of the remaining two variables, and if the resulting 
expression is substituted for z in u /(x, y, 2 ), there will be 
obtained a function u = F(x, y). The values of x and y that 
yield maxima and minima of u can be found by the methods of 
Sec. 89. However, the solution of (f{x, y, z) = 0 for any one 
of the variables may be extremely difficult, and it is desirable to 
consider an ingenious de\dce used by Lagrange. 

To avoid circumlocution the maximum and minimum values 
of a function of any number of variables will be called its extremal 
values. It follows from Sec. 89 that the necessary condition 
for the existence of an extremum of a differentiable function 
/(^ij , Xn) is the vanishing of the first partial derivatives 

of the function with respect to the independent variables Xi, 
X 2 , ■ * • , Inasmuch as the differential of a function is 
defined as 


it is clear that df vanishes for those values of Xi, x->, • • • , Xn 
for -which the function has extremal values. Conversely, since 
the variables Xi are assumed to be independent, the vanishing 
of the differential is the necessary condition for an extremum. 

It is not difficult to see that even wffien some of the variables 
are not independent, the vanishing of the total differential is 
the necessary condition for an extremum. Thus, consider a 
function 


(90-1) 


« = /(*, y, z), 
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where one of the variables, say 2 , is connected with x and y 
by some constraining relation 


(90-2) 




Regarding x and y as the independent variables, the necessary 

conditions for an extremum give ^ = 0 and ^ = 0, or 

^ dx dy ^ 

dx Sx dz dx ’ 

dy dy dz dy 

Then the total differential 


du j , du j df j , df j dffdZj , dz ^ 

_ & + _ ij, . _ & + <iv + * + 5^ dj/j = 0. 

and, since the expression in the parenthesis is precisely dz, it 
follows that 


(90-3) 


dx dy dz 


The total differential of the constraining relation (90-2) is 


(90-4) 


^ dx + ^ dy + ^ dz = 0. 
dx dy ^ dz 


Let this equation be multiplied by some undetermined mul- 
tiplier X and then added to (90-3). The result is 






\dz ' "av ' \dy ' ‘'dy, 
Now if X is so chosen that 


dz dz 


(90-5) 


/^4.X^ = 0 
1 dx ’ 

| + ^5P = “> 

i <p(x, y, z) = 0, 
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then the necessar}’' condition for an extremum of (90-1) will 
surely be satisfied. 

Thus, in order to determine the extremal values of (90-1), 
it is merely necessary to obtain the solution of the system of 
equations (90-5) for the four unknowns x, y, z, and The 
multiplier X is called a Lagrangian inultipUcr. 

Example 1, Find the maximum and the minimum distances 
from the origin to the curve 

ox- + 6xz/ -f 5^- — 8 = 0. 

The problem here is to determine the extremal values of 

f{x, y) = x--{-y- 

subject to the condition 

<p{x, y) - 5x2 _j_ Qj^y ^ 5^2 _ g ^ 0 ^ 

The equations (90-5) in this case become 

2x + X(10x + Qy) = 0, 

2y + X(6x -f lOy) = 0, 

5x2 ^ 5^2 _ g 

Multiplying the first of these equations by y and the second by x, 
and then subtracting gives 

6X(z/2 - X-) = 0, 

so that y = ±x. Substituting these values of y in the third 
equation gives two equations for the determination of x, namely, 

2x2 == 1 0^32^ ^2 -- 2, 

The first of these gives f = x- + y- = 1 and the second gives 
/ = ^2 — 4 ^ Ob^dously, the first value is a minimum, 

whereas the second is a maximum. The curve is an ellipse 
of semiaxes 2 and 1 whose major axis makes an angle of 45° 
with the x-axis. 

Example 2. Find the dimensions of the rectangular box, with- 
out a topj of maximum capacity whose surface is 108 sq. in. 

The function to be maximized is 


f{x, y, z) = xyz, 
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subject to the condition 

(90-6) xy -|- 2xz -}- 2yz = 108. 

The first three of the equations (90-5) become 

( yz + \{y + 2z) = 0, 

(90-7) < a:2 -f- X(a: -f- 2z) = 0, 

(xy + X(2x -f 2y) = 0. 

In order to solve these equations, multiply the first by x, the 
second by y, and the last by z, and add. There results 

\(2xy -I- ixz -f 4yz) -|- Zxyz — 0, 
or 

Xixy 2xz -h 2yz) + %xyz = 0. 

Substituting from (90-6) gives 

108X -f- ^'ixyz = 0, 
or 

, _ xyz 
^ 12 

Substituting this value of X in (90-7) and dividing out common 
factors gives 

1 - + 2z) = 0, 

l-^{x + 2z) = 0, 

1 - ^(2x -f 2y) = 0. 

From the first two of these equations it is evident that x = y. 
The substitution of a: = y in the third equation gives s = — • 

y 

Substituting for y and z in the first equation yields x = 6. Thus 
a; = 6^ 2 / = 6, and 2 = 3 give the desired dimensions. 

PROBLEMS 

1. Work Probs. 1, 2, and 3 of Sec. 89 by using Lagrangian multipliers. 

2 . Prove that the point of intersection of the medians of a triangle 
possesses the property that the sum of the squares of its_distances from 
the vertices is a •miniTnnm 
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3. Find the maximum and the minimum of the sum of the angles 
made by a line from the origin vdth (a) the coordinate axes of a cartesian 
s^'stem; (h) the coordinate planes. 

4. Find the maximum distance from the origin to (a) the folium of 
Descartes + ij^ — Saxij = 0; ib) the ellipse 

llx- + 6xy -T 3?/- - 12a; - 12^ - 12 = 0* 

5. Find the shortest distance from the origin to the plane 

ax 'T by cz = d, 

91. Lagrange’s Multipliers. The discussion of the preceding 
section, showing that the vanishing of the total differential is 
the necessary condition for an extremum, is perfectly general 
andcanbe extendedinime(iiatelytothefunction/(a;i, 2 : 2 , • • • , 0 *^) 
of n variables, several of which may not be independent. 

Thus, consider a function 

(91-1) XV = fix, y, z, u), 

and let the constraining relations be 

(91-2) tf' "! = 

\cp 2 {x, y, z, u) = 0. 

The relations (91-2) vdll be thought of as defining the variables 
z and u as functions of the independent variables x and y. Then 
the necessary conditions for an extremum are 


c 

dx 


and 



or 

dx dx dz dx du dx ’ 

_L m ^ - 0 

dy dy dz dy du dy 

Multiplying the first of these equations by dx, the second by 
dy, and then adding, 


(91-3) dw = f^dx + fydy + ^^dz + ^ldu = 0. 
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The constraining relations (91-2) give 


(91-4) 


dx dy dz du 

don 7 , 9(02 7 , d<p2 , , d(P2 J „ 

dx + dy + dz + ^ du = 0. 

dx dy dz du 


Multiplying the first of the equations (91-4) by Xi and the second 
by X 2 , and adding the resulting equations to (91-3), 



This equation is satisfied if Xi and Xo are so chosen that 
\dx dx dx ’ 


(91-5) 


\df ,7 '^¥’1 I > ^^2 _ „ 

l^ + Xi— - O' 

4 - \ -U \ ^^2 _ 


The four equations (91-5), together mth the two constraining 
relations (91-2), can be used to determine the values of x, ?/, 
z, u, Xi, and Xo, which give extremal values of (91-1). 

The procedure just outlined can be extended in an obvious 
way to cover the case of more than two constraining relations 
and more than four variables. This discussion leads to the 
following rule : 

Rule. In order to determine the extremal values of a function 


(91-6) f{xi, a;2, • • • , Xn) 

whose variables are subjected to m constraining relations 
(91-7) ipi{xi, 0 ^ 2 , • • • , xf) =0, (^ = 1, 2, • • • , m), 

form the function 


F' = f + 2^X£ (Pi, 
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and detemiine the 'parameters X* and the values of xu 
from the n equations 

(91-8) = (i = 1, 2, 


and the m eqiiatio7is (91-7). 

As an illustration, consider the problem of determining the 
maximum and the minimum distances from the origin to the 
curve of intersection of the ellipsoid 



with the plane 


Ax + By + Cz = 0. 


The square of the distance from the origin to any point 
(x, y, z) is 

/ = -h 

and it is necessary to find the extremal values of this function 
when the point {x, y, z) is common to the ellipsoid and the plane. 
The constraining relations are, therefore, 

(a) = + 1 =0, 

^ ^ ^ a- 0- c-' 


and 

(5) ci ?2 = + By + Cz — 0. 

The function F = / + Xi^i + Xo^^j is, in this case, 

F = x-^ + y- + z- + - i) 

-i- 2 X 2 (--ia; -T By + Cz), 

where the factor of 2 is introduced in the last term for con- 
venience. Equations (91-8) then become 

X "t" ^1^ “h X2.d. = 0, 

y + Xip H- Xo^ = 0, 

s -f- Xi-j -f- XaC = 0. 

C" 
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These equations, together with (a) and (6), give five equations 
for the determination of the five unknowns x, y, z, Xi, and Xo. 
If the first, second, and third of equations (c) are multiplied by 
Xj y, and z, respectively, and then added, there results 

^2 2^2 ^2 _j_ Xi^^ “1“ ^ 2 (-4a; + By + Cz) = 0. 

Making use of (a) and (6), it is evident that 

Xi = -(x- + y^- + z^-) = -f. 

Setting this value of Xi in (c) and sohdng for x, y, and Zj 


rcl 1 ~ ^ 


= 0 , 


or 

or 

or 


X = 


X24a2 
a- — f 


y = - 


\ 2 By- 


XsCc^ 
^2 _ f* 


When these values of a;, y, and z are substituted in (b) one obtains 

A!bL+ + 


from which / can be readily determined by solving the quadratic 
equation in /. 


PROBLEMS 

1. Find the point P, in the plane of the triangle ABC, for which the 
sum of the distances from the vertices is a minimum.* 

2. Find the triangle of minimum perimeter which can be inscribed 
in a given triangle. 

* See E.Goursat's Mathematical Analysis, vol. 1, English ed., p. 130, fora 
detailed discussion of this interesting problem. 



CHAPTER X 
IMPROPER INTEGRALS 


In defining the definite integral, dx, it is assumed that 

the function /(x) remains bounded in the interval (a, 6), and that 
the end points a and h of the interval are finite. If either (or 
both) of these assumptions is not satisfied it is necessarj' to 

attach a new interpretation to the symbol £f{x) dx. If the 

function f{x) becomes infinite in the interv'al a ^ 2 : ^ h, or if 
the limits of integration become infinite, then the symbol 

dx is called an improper integral. It vill be seen that 

the improper integrals are defined as limits of certain functions 
which arise from a consideration of ordinary definite integrals. 

92. Integral with Infinite Limit. If the function f{x) is 
bounded* and integrable for x ^ a, then the symbol 

(92-1) dx 

is defined by the equation 



If this limit exists, then the integral (92-1) is said to converge; 
otherwise it is called a divergent integral. The divergent integral 

can arise in two ways. It may happen that dx becomes 

infinite with h, or it may be that this integral oscillates without 
approaching any limit. Thus, 

* The definition of an integrable function f{x) (Sec. 35) demands that 
f{x) be bounded; hence, the statement that the function is hounded and 
integrable is redundant. However, some authors extend the class of func- 
tions integrable in the sense of Riemann to include those unbounded func- 
tions whose improper integrals exist (see Sec. 94). The word bounded is 
inserted here to preclude the possibility of interpreting the term integrable 
function in the extended sense. 
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r = lini r = lim (2'\/6 — 2V a). 

The expression within the parentheses becomes infinite with h. 
On the other hand, for 

sin X dx = lim sin x dx = lim (cos a — cos 6) 

^ h—> sc v 5— > so 

the expression in parentheses oscillates as b is increased and does 
not approach any limit. Both of these integrals are called 
divergent. However, 


r ” xdx _ X dx 

Ja {X^- + 1 )' “ Ja + 1 


(X^‘ + 1) 

converges to the value 


+ D* 

+ 1)2 - (62 + 1)2 


4(a2 + 1)^ 

'•6 


Similarly, 

f'j(x)dx 

is defined as the limit of the function when a becomes 

negatively infinite, so that 

P fix) dx = lim Cf{x) dx. 

J — a— )•— 00 

It may happen that the integral dx of a bounded function 

fix) exists for aU finite values of a and 6; in that case the symbol 




is understood to mean 


(92-2) J{x) dx+f^ ’‘fix) dx, 

where c is any real number. 

It is clear that a study of an improper integral with a con- 
tinuous integrand /(a;) reduces to a study of the behavior of the 
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limit of the function F(;x) els z-^ x , where F{x) = i: 'fix) dx. 

The conditions under which a function Fix) converges to a 
limit have been discussed in Chap. I, and a direct application 
of the fundamental principle of convergence to a limit furnishes 
the following theorem. 

Theorem 1. A necessary and sufficient condition that J* dx 

be convergent is that, for any arbitrarily syyiall positive nuiyiber e, 
there exist a number N such that 

i 

(x) dx. < € 

for all values of p and q which both exceed N. 

However, the application of Theorem 1 to the determination 
of the convergence of a particular integral is likely to be difScult. 
For this reason some simple practical tests are developed with 
the aid of Theorem 1 and the following theorem. 

Theorem 2. If fix) is coyitiniwus for x > a and if J' “;/(a-); dz 

exists, then f(x) dx also exists. The function fix) is then said to 

be absolutely integrable over the infinite iyiterval. 

In order to prove this statement, write 

m - m + ifm - fi^i. 

Then 

(92-3) ffi^) 

By hypothesis the second integral in the right-hand member of 
(92-3) converges when 5 ^ co , But 

0 fix) -f- \fix)\ < 2iifix)\; 

hence 

0 ^ £lfi^) + \fix)\] dx ^ £2\f(x)\ dx. 

Since the integral J^*2|/(a;)l dx is convergent as & ^ x , it follows 

that the first integral in the right-hand member of (92-3) also 
converges. 

The converse of Theorem 2 is not true. The integral of fix) 
may converge over an infinite interval when the integral of 
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|/(a;)| does not converge. This corresponds to the situation 
in infinite series when a series converges conditionally. 

As an instance of such beha'vdor consider the integral* 


(92-4) 


sin X j 
dx, 

to X 


which is convergent but not absolutely convergent. The con- 
vergence of the integral (92-4) will be established with the aid of 
Theorem 1. 

It follows from the second mean-value theorem for integrals 
(Sec. 37) that 


r®sin X , 1 ^ _L ^ * 

Jp ^ vJp 

where 0 < p ^ | 

q. But 

sin X dx\ 
Up I 

;< 2 and j sin x dx 

Consequently, 



dx, 


^ 2 . 



Now if any € > 0 is prescribed, the inequality 


IX 


sin X 

X 


dx\ 


< e 


will surely be satisfied for all values of p and q that are greater 
4 

than N = — Thus, the integral (92-4) is convergent, f 


* It is customary to define the value of ■ 


at a; = 0 as unity, so that 


sin a; . 

IS a contmuous function. 

X 


t It will be shown in Sec. 97 that 


r 


sm a; , tt 
— dx — — 
X 2 
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In order to prove that 
(92-5) 




f . I 

sm X 


! dx 


diverges, note that for an}^ positive integral value of k 

*(A4-l)r! 






dx 


n»0 


a:i 


Now, for TO > 0, 


(92-6) 


rCn+lW 


^ n-K 


ism X 


X 


dx 


%j n 


I dx. 


Isinxi 


dx = 


(n + lV ^ (n + l)7r 


since the minimum value of - in the interv^al [m, in + 1)t] 

X 


IS 


(to -t- l)ff 

k 


71 = 0 


It follows that 


p(n + l)7r 

sin X 

) me 

X 




dx>-[l+\ + \ + 


+ 


rii) 


and, since the series in the right-hand member of this inequality 
diverges as co ^ the integral (92-5) is also divergent. 

It may be remarked that the function /(x) need not approach 

zero as oo in order that the integral ” fix) dx be convergent. 
Consider, for example, the integral 

j\mx^dx, 

and assume that it can be written as the sum of a series of inte- 
grals, namely, 

00 

(92-7) f "sin dx = 
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The series in the right-hand member of (92-7) is readily sho^^m to 
be convergent, but the integrand of (92-7) obviously does not 
approach zero as x . 

In order to prove the convergence of the series, let the variable 
X be changed by the substitution 


Then 


X = 


P V (n+l)x 

V" rtx 


J, 


sin X- dx 


1 psin (g + rnr) , 
2 J 0 \/z + nir 
1 sin g , 

2J0 


It is clear from this form of the general term of the series that 
the series in the right-hand member of (92-7) is alternating and 



decreasing in such a way that the limit of the Tith term as 
n 00 is zero. Consequently, the series and, hence, the integral 
(92-7) converge. 

The question of the legitimacy of the infinite series representa- 


tion (92-7) of the integral sin dx will be settled in Sec, 96, 


but it is not at all necessary to resort to this method of establish- 
ing the convergence. In fact, a substitution of ^ y leads to 

a consideration of the integral I — ~ dy, which is readily 

Jo Vy 


shown to be convergent. * 


* See the illustration at the end of Sec. 93 and Example 2 of Sec. 95. 
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The reason for the convergence of this integral may be seen 
from geometrical considerations (Fig. 75). The areas bounded 
by the successive arches of ?/ = sin X“ decrease with the increase in 
71, because the difference of consecutive roots, \/(ti + l)v - x'Hw, 
of sin X- tends to zero when 7i cc , while the maximum height 
of each arch always remains equal to unity. 

93. Tests for Convergence of Integrals with Infinite Limits. 
This section contains some practical tests for determining the 

convergence of the integral f(x) dx, where /(x) is a continuous 

function for all values of x ^ a. It will be assumed throughoiif: 
this section that a is a positive number. This entails no loss 

of generality, since the integral f f{x) dx, where the lower 

Jao 

limit ao is negative, can be written as the sum of two integrals, 
namely 

fy(x) dx = fy(x) dx + fy(x) dx, 

Jao Jao Ja 

where a is a positive number. 

Theorem 1. If f{x) is continuous for x > a aiid there exists a 
'positive number A such that 

\f{x)x^\ < A when x > a, 
then converges absolutely if k > L If ^ A 

and k < 1, then the integral f{x) dx diverges. 

The proof of the theorem is simple. For, if 

i/(*)i < 

then 

(93-1) £ |/(x)| dx < ^ dz. 


But 



and, H k>l, the right-hand member of (93-2) approaches the 
limi t Thus, the integral on the 
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right of the inequality (93-1) exists, and, since J^\S{x)\ dx is 
an increasing function of x, the integral !/(a:)| dx exists. It 
follows from Theorem 2, Sec. 92, that f /(x) dx exists. 

»/a 

The proof of the second part of the theorem is just as easy. 
For 

1 /( 2 :) I ^ ^ 2 : ^ a. 

Therefore, 

r |/(a:)| dx > A f ^dx. 

J a J a 


A. 

But if |/(a:)l ^ -jj then /(a:) cannot change sign for x > a, since 
cc 

f{z) is a continuous function. Suppose that /(a:) > 0; then 
f \fix)\ dx = [ fix) dx'Si a{ ^^^dx. 

J a CL J 


But 





= log 6 — log a. 



if A < 1; 

if fc = 1, 


which diverges as 5 — >■ co . 
If /(a;) < 0 for a: S: a, then 


Consequently, 


^ /(aj) dx diverges. 


£\fix)\ dx = -£fix) dx, 


and the assertion that J^fi^) dx diverges follows immediately 

from the proof for the case when fix) > 0. 

This theorem is capable of a simple geometrical interpretation. 
A 

If \f(^)\ < then the graph of the function y = f{x) lies 

SC 

A 

between the graphs of y = ±~i (Fig. 76). Consequently, 

z 

the area under the curve y = bounded by the ordinates 
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X = a and x = b and the x-axis, is greater than the area under 
the cur\-e y = 'fix)], so that 

jJjT. 

If the integral on the right of this inequality is convergent^ 
then the integral on the left will surely converge. 



If, on the other hand, 


then the area under the curv^^e y = /(a:) will not be less than that 
A 

under y = —j so that 


A particularly useful form of Theorem 1 appears w'hen f(x) 
is such a function that lim x^f{x) exists. In such a case Theorem 1 

X — ^ 00 

can be phrased as follows: 

Corollary. If lim x^f{x) = L, where k > 1, then f f{x)dx 
converges absolutely. 
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If lim x'‘f(x) = L 9^ 0 and h < 1, then f fix) dx diverges. 

Z—^ 00 

As an illustration of the application of this corollary consider 

dx 


Since 


I' 


(1 + x^)^ 


lima:2 


(1 + a:® 


= lim 

z--^ « 


it follows that the given integral is convergent. 

The reader will have no difficulty in deducing, with the aid 
of the corollary, the following useful theorem. 

Theorem 2. If f{x) = where Pi{x) and P^{x) are poly^ 

nomials in x and P^{x) Q for x > a, then the necessary and 
sufficient condition that f(x) dx converge is that the degree of 

P^ix) exceed the degree of Pi(x) by at least two. 

Theorem 3. If f{x) is continuous for x > a and there exists a 
positive number A such that \e^^f{x)\ < A when x > a, then 

fix) dx converges absolutely if k > 0. If \e^^fix)\ > A, 
then I f(x) dx diverges if k < Q. 

•/a 

The proof of this theorem follows by using the argument 
employed in establishing Theorem 1, and by noting that 
'6 1 

— e-^), if k 9^ 0, 

IV 

= h — a, if k = Q. 

Corollary. If lim fix)d‘^=L and k > 0, then [“fix) dx 

Z~> oa Ja 

converges absolutely. 

If Mm fix) e^^ = L ^ 0 and k < Oj then f^f(x) dx diverges. 

z—^ 00 

As an illustration consider 

fo° 

Since 

lim e^e~^^ = lim = 0, 
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it follows that the given integral is convergent. 

Theorem 4. If <f{x) is a monotone fioidion which approaches a 
finite limit as x mcreases indefinitely, then 

X7w * 

will converge if _£ V(^) dx converges. 

The proof of this theorem follows from Theorem 1, Sec. 92, 
with the aid of the second mean-value theorem for integrals 

(Sec. 37). The convergence of i: fix) dx requires that there 

exist a number A’ such that when p and q are any numbers 
greater than N, then 



f dx ) dx 


where p, and q are all greater than N. Then, if L is the limi t, 
approached by <pix) as x increases, and if ft is the larger of \L\ 
and |«5(a)i, it is evident that 


Therefore, 


dx 


dx\ 


<2di = d. 


dx 


if p and q are any numbers greater than N. 

By a similar argument it can be shown that if cs(x) is a mono- 
tone function which approaches zero as x increases indefinitely, 

then ^ <pix)fix) dx converges if dx remains bounded 

as 6 mcreases indefinitely. It should be noticed that this state- 
ment does not require that dx converge to a limit as b 

is increased. 

For example, the integral 

'sin X 



346 


ADVANCED CALCULUS 


where fc > 0, can be written as 


j: 


—r sin X dx. 


Since is a monotone function which approaches zero as x 


increases, and since sin x dx — cos 1 — cos h which oscillates 

as 6 increases, it follows that the given integral is convergent. 
The convergence of this integral was discussed in Sec. 92 for the 
case in which it = 1. 

As another example, consider 


This integral can be written as 


_a2 

Now e is a monotone-increasing function which approaches 
the limit 1 as a: increases, and dx was shown to converge. 

Hence, 


is convergent. 

PROBLEMS 

Test the following integrals for convergence or divergence: 
*cos X 


‘■r 




dx. 


dx 


a; v 1 + a;^ 
X dx 


Jo a/ 2 + a;3 
^ 00 

I 6“®^ sin X dx. 

Jo 


■£ 

■f. 


2 (1 + 
e~‘ sin X 


dx. 

dx. 


7, 

8. 
9 . 

10 . 

11 . 

12 . 


sm X 
x^ 


■Il 

f* 00 

J X si: 

’ jo 


ax. 


sin X 

+ a;2 


dx. 


C “tan-1 

ji 1+t 
r “ s 

jo 1 
^ 00 

Jo vr+V" 

C“‘_dx 

Jo 1 


+ X 

dx 


+ a;® 
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94. Integrals in Which the Integrand Becomes Infinite. If 

f(x) becomes infinite for some value of x = c, where a < c < b, 
then, by definition, 

(94-1) r/(x) dx = lim r~y(x) dx — !im P fix) dx, 

,._>0 jc-f ’ 

and the integral is said to exist if the limits of the two integrals on 
the right-hand side of (94-1) exist. In ease/(x) becomes infinite 
at X = a, then, by definition, 

Cfix) dx = lim p, f(x) dx, 

and if f{x) becomes infinite at x = 6 , 

f fi-^) = lim y(j:) dx. 

It may be observed that, since 

lim r fix) dx = lim [Fib) - F(a -h e)], 

e - 0 

where F{x) is the indefinite integral of /(a;), the integral con- 
verges if lim jP(a + e) exists. If the indefinite integral can 
€->0 

be found, the evaluation of the definite integral is accomplished 
in the process of determining its convergence. 

It is important to note that the variables €i and 62 in the 
definition (94-1) are assumed to approach zero independently 
of one another. The same variable e is used occasionally in 
the definition, so that 

(94-2) J^V(^) (X"" 

But the limit in (94-2) may exist when the limits in (94-1) do 
not exist. If the limit in (94-2) exists and is equal to L, then 
the value L is called Cauchy's 'principal value of the integral 

rfix) dx. 

^ G / 

If fix) becomes infinite at both end points of the interval 
but remains bounded within (o, b), then the integral of fix) 
is defined by the equation 

^fix) dx = lim r fix) dx - 1 - lim ^ 
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where each of the limits on the right must exist if the integral 
J* J{x) dx is to converge. 


The definitions given above can be extended in an obvious way 
to include the case where f{x) has any finite number of dis- 
continuities in the interval (a, h). 

Example 1. 


^dx 


= Hm 
Jo 




Hence, the integral does not exist. 
Example 2. 


i: 


dx 




lim 
£ — >0 


r — ^£= 33 = lim (-2\/ e + 2 V 2 Y 
Jo V2 - a; ^^0 V J 


and thus the integral converges to 2\/2- 
Example 3. 

X dx _ ^ ^ 

Jo eZjo - 1)^ 

+ lim |^|(2) - |(ei + 262)^ • 

Therefore the given integral is convergent to 
Example 4. 

dx C^^^dx C^dx 

J —1 X €X— >0 — 1 X €2—^0 tJ €Z X 



lim (\ 

— 1 ) + lim ( 1 ■ 

-i)i. 


2Lei^0 Vl 

/ 62-^0 \ 

4/J 

and therefore, the 

given integral does not converge. 

€2 = €i = €, then 




J-ia:® 

limfr^ 

+0) 


= 

s[-K? 

- 1 + 1 - p) 

= 0. 

Hence, the principal value of J 

^ dx 

— is equal to 

-iX 

zero. 
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It is clear from the foregoing that the determination of the 
convergence of improper integrals, with diseontiniioiis integrands, 
is reduced to the study of the behavior of the limit of the fimctioii 
Fie) as € —> 0, wdiere F{e) is of the form 


From the definition of the limit of a function (Sec. S) and from 
the fundamental principle of convergence (Sec. 5), it follow’s that: 
The necessary and sufficient condition that lim F{e) exist is that, 

for any preassigned positive manher t}, one can find a niwiber d 
such that 

\Fie 2 ) — Fiei)\ < 7] 
whenever 0 < €2 < ei < 5. 

Recalling the definition of Fie) one can state the following 
theorem: 

Theorem. A necessary and sufficient condition for the conver- 
gence of the integral 

ivhose integrand becomes infinite at x = a is that for any pre- 
assigned number 17 > 0, one can find a positive number 8 such 
that 

, , ''/(x) dxi < 7 } 

a-re2 

whenever 0 < €2 < €i < 5. 

It follows from this theorem that if f ]/(x) j dx is convergent, 

then fffix) dx will surelj’' converge. The converse of this 
statement, however, is not true. For, consider the integral 



Setting X = - gives the integral 

y 


sin y 


dy, 
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which was shown to be convergent, but not absolutely convergent 
(see Sec. 92). 

95. Tests for Convergence of Integrals Whose Integrands 
Become Infinite. Corresponding to the tests given in Sec. 93 for 
the convergence of integrals vdth infinite limits, one can develop 
tests for the convergence of integrals w^hose integrands become 
infinite in the interval of integration. One of these tests is 
given next. 

Theorem. If f(x) is continuous for a < x < b and there exists a 
positive number A such that \f{x){x — aY\ < A for 0 < ^; < 1 and 

a < X < b, then j* f{x) dx is absolutely convergent. 

If l/(^)(^ ^0^1 > A for k > 1 and a < x £ b, then j^ix) dx 

is divergent. 

The proof of this theorem is entirely similar to that of Theorem 
1, Sec. 93. It is only necessary to observe that 



dx 

“ o) 


k 


exists if fc < 1 and does not exist if ^ 1. 

Corollary. If lim {x — aYf{x) — L, then j^^f(^) dx converges 
absolutely if < h < 1 , 

If lim {x — aYf{x) = L 7 ^ 0 , then Pfix) dx diverges if k > 1 . 

a:-^a+ 

Example 1. Consider 

dx 


Since 


lim {x — 1)^V 

14 - c 

it follows that the given integral is convergent. 
Example 2. Consider 


Now 

sin X sin x 



X' 


X 


X‘ 



IMPROPER INTEGRALS 


351 


But, since lim 


sin X 


1, it follows that 


X 

= lim x*" 

This limit will exist provided that n - 1 < k. Thus, if n < 2, 
the integral is convergent, and if n > 2, the integral is divergent. 
Exarnple 3. Consider 


sin X dx. 


Note that 


log sin X — log 


I"- 


sm X 


log X -r log 


sm X 


But 


lim xd' log sill x = lim { log x + x^ log L 
0 ^0 \ ^ / 


sm .T 


Since lim x^= log x = 0 if J: > 0, and lim 

X— i-O X-*0 X‘ 


= 1, it is eiident 


that lira x''- log sia .r = 0. ’.vhen J: > 0. Consequently the integral 

X-H-0 

converges. 

PROBLEMS 

1 . Test the following integrals for convergence or divergence: 

dx 


(а) 

(б) 
(c) 
id) 
(e) 


cos X , 
—^dx\ 

V X 


s/ 1 — X 
2 dx 


dx; 


X 

Jo 

n dx 

Ji - 1’ 

r 


dx 


dx 


\/ x(x — 1)' 


(i) I x” log X dx; 

Jo 

U) 


■ dx, a < 1. 
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2. Prove the convergence of the integrals 
(a) E 


— e-a;- 

— 7 --7 — - dx, 0 < e <1; 

Jo _ 


(h)F^ 


i 


's/ a- — X- 
^ dx 


V(1 " 


0 < e < 1. 


These integrals are known as the elliptic integrals of the second and first 
kinds, respectively. 

3. Prove the convergence of the integrals 


«) 




dd 


0 < e < 1; 


'y/l — sin^ S 
(b) I -v/l — sin- 9 dO, 0 < e < 1. 


Set a; = sin dj and use the results of Prob. 2. 

4. If P{x) and Q(x) are relatively prime polynomials, show that 
^P(x) 

dx diverges whenever a root of Q{x) falls in the interval 
a < X < h. 


96. Operations with Improper Integrals. Inasmuch as the 
improper integrals are defined as the limits of certain functions, 
it is natural to inquire whether it is permissible to perform the 
same operations on improper integrals as are familiar in the case of 
finite integrals. It is clear from a consideration of the examples 
in Sec. 92 that the behavior of some improper integrals is closely 
analogous to that of infinite series, and this fact alone is suflBLcient 
to indicate the need of caution. 

It is true that the equation 

f^cf(x) dx = dx, 

when c is a constant, is valid, even when the integrals are 
improper, since in applying the limit process, the constant c can 
be placed either inside or outside the limit sign. 

The equation 

(96-1) £[SAx) + / 2 (a;)] dx = dx -f dx 

however, is not always true. It may be that ^ 5 ( 0 :) = J\{x) -I -/21 
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is a function %vhose integral converges, whereas the integrals 
of fi{x) and/ 2 (a:) are divergent. Thus, 

--\dx 


is divergent, as is 


but 



dx 


is convergent. However, if any two of the integrals in (96-1) 
converge, then the third integral also converges, and Eq. (96-1) 
is true. Similarly, if any two of the expressions in the formula 
for integration by parts, 

(96-2) £, dx=Mx)f,ix) idx, 

exist, then the third expression also exists and the relation (96-2) 
is valid. 

Matters are considerably more involved when one considers 
the differentiation and integration of improper integrals vdth 
respect to a parameter, and it is necessary to impose more severe 
restrictions on the integrands than was the case with the ordinary 
integrals. Thus, consider an integral containing a parameter, 
namely, 


(96-3) F(a) = ( ' dx, where 

JO ^ 

If the differentiation under the integral sign be performed 
formally there results the integral 


X' 


cos ax 


which is divergent and consequently does not represent the 
function F'{a).* 


* It may be remarked that the function defined by the integral (96-3) is a 

00 

I sm z 

constant. For, setting z — ax gives I — • ds, which is independent of a, 

Jo 2 


Consequently, F'(a) = 0. 
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The difficulty encountered here is essentially of the same 
sort as that appearing in the differentiation of series term by 
term. In fact, it will be shown next that a study of the con- 
vergent improper integrals of the form 

(96-4) F{a) = 

where /(x, a) is a continuous function ior x ^ a and for every 
value of a in the interval a cei, is equivalent to the study 
of a series of integrals. 

Let 


a ^ ai < < az < • * • < an < * * * 


be any increasing sequence of numbers such that 

lim an — 00 . 

n— > 00 


Then the integral (96-4) can be written as an infinite series of 
integrals, namely,* 

(96-5) O') dx = p' fix, a) dx -f f^ix, a) dx + • • • 

Ja Ja — ai Jai 

"y(x, a) dx + • • * 


Now each term of the series in the right-hand member of (96-5) is 
a continuous function, so that 

00 

(96-6) JJ'fix, a) dx = '^Uni.a), 

n~l 


* It is important to note that the requirement that the integral be con- 
vergent is essential if one is to reduce the study of the integral to that of the 


series. For example, sin a; da; is divergent, but the series 
00 

J '*2t . f47r ^ r2(n + lW 

^ sm a; da; + sm a; da; -h * * * + sin a; da; + * 

oo 

has its sum equal to zero. Accordingly, r sin X dx ^ ^ Un. 


n = 0 



§96 

where 


IMPROPER INTEGRALS 


355 


If the series ^ «r„(a) is uuiiornil}' convergent, then the function 

7i = 1 

F{a) will surely be continuous. Accordingly, one can borrow 
the terminology of infinite series and say that the integral (96-4) 
will define a continuous function if it is uniformly convergent. 
This, of course, means that the series (96-6), which represents 
the integral, is uniformly convergent. Inasmuch as the con- 
struction of the series (96-6) is not unique, it is more convenient 
to define the uniform convergence of the integral (96-4) as follows: 

Definition. The integral f(x, a) dx converges uniformly in 

the interval < a ^ ai if, corresponding to any € > 0, one can 
find a number N, independent of a, such that 

7(^? oi) dan < e 

for every value of a in the interval (ao, «i,) whenever p > N. 

If the integral dx converges uniformly, then the 

series (96-6) will also converge uniformly, so that for any e > 0, 
one can find a number N independent of a such that 


whenever n ^ iV*. 

As in the case of uniform convergence of series, the definition 
does not provide a useful test for uniform convergence. A 
simpler test for uniform convergence of integrals follows directly 
from the Weierstrass test for series. 

Weierstrass Test for Integrals. If <p{x) is a positive and 
continuous function for x > N, and if \f{Xj o:)l ^ <p(x) for 
ao ^ a ^ ai and x ^ N, then 
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is uniformly and absolutely convergent for every a in the interval 
(ao, oil) provided that (p{x) dx converges. 

It was remarked earlier that the function F(a), defined by the 
integral (96-4), mil surely be continuous in the closed interval 
(cKo, cif) if the integral converges uniformly. 

Using the notion of uniform convergence of improper integrals 
and noting Theorems 2 and 3, Sec. 70, it is easy to establish the 
following sufiScient condition for integrating and differentiating 
under the integral sign. 

Theorem. Letf{Xj a) he continuous in x and a for ao :< a < 
and for all values of x ^ a; then 

F{a) ^ 


can he integrated under the integral sign with respect to a in any 
interval (/Si, ^ 2 ) contained in (ojo, ch) to yield 

da = £ ") da dx, 


f(Xj a) dx is uniformly convergent in ( 0 : 0 , ^i). 

Moreover^ if f 

J a 


da 


■ dx converges uniformly for every value 


of a in the interval (ao, oji) and fa is continuous, then 


Some applications of this theorem to the evaluation of improper 
integrals are indicated in the next section. 

PROBLEMS 

1. Establish the uniform convergence of the following integrals: 

{a) cos ax dx; 

(b) a > 0; 

(c) e~^^ x^ dx, a > 0. 

2 . Integrate f cos x^ dx, (b > a), by parts and obtain 

Ja 
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Deduce from the result the convergence of the integral J" cos x* dx. 

3. Use integration by parts to show that ^ “cos x log xdx diverges. 

4. Use integration by parts to show that cos x log x dx converges to 

97. Evaluation of Improper Integrals. This section is con- 
cerned mth the evaluation of several improper integrals that 
cannot be calculated directly ■with the aid of the fundamental 
theorem of the integral calculus. It will be seen that the theorem 
of the preceding section plays an important part in nearly all 
the examples considered below. 

Example 1. Let it be required to evaluate the probability 
integral 

-X‘ 

The convergence of this integral has already been established, in 
Sec. 93, but it will be profitable to attack the problem in a 
different way which will lead to an estimate of the magnitude of 
the number I. 

Now 


But, if X lies between 0 and 1, then 

£xe-^‘dx<f^-^^dx, 


and 


X‘ 


Furthermore, if 0 ^ x ^ 1, then < 1, so that 

£e-^^dx<l. 

Consequently, 


(97-2) 
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Similarly, if 1 < x < qo ^ then 

0 < dx < dx. 

The integral xe~^‘dx can be calculated with the aid of 
the fundamental theorem to give 


Hence, 

(97-3) 


j: 


CO 

xe~^' dx 


2e 


0 < 


^ 00 
J. ^ 


‘ dx < 


2e 


It follo-n^s from (97-2) and (97-3) that 


da: < 1 -1- 

2e 

The exact value of (97-1) will be obtained with the aid of 
the following ingenious device. Since I is not a function of 
the variable of integration, one can write 

(97-4) I = dy. 

Multiplying (97-1) by (97-4) gives 

dxj^ dy 


Transforming to polar coordinates by means of 

X = r cos d 
y = r sin dj 

and noting that the integration extends over the area of the first 
quadrant of the x^z-plane gives* 


P = 


I I e“^V dr dd = 
lo Jo 4 


* See Sec, 46, 
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Hence, 


7 = 


The same de\’ice can be used to evaluate 


Example 2. Evaluate 

^(a) = 

for a > ao > 0. Since for any a > 0 there exists a number N 

1 1 
such that ^ ^ for a: > iV, it follows that i for 

X > N. Moreover, 

dx 

converges, and therefore, the given integral converges ■uniformly. 
Then, assuming the existence of the integral, 



Hence, 



Example 3. Evaluate 


Now 




‘ cos . 


<p 



“ xe~^' sin ax dx 


and, since 

\xe~'^^ sin ax I < 

whose integral is convergent, the differentiation is justified. 
By integration by parts. 



cos 


sin OCX 


a 
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But if 


then 


or 


and 


d<p _ 

a<p 

da 


d(p __ 

-Kda 

ip 

2 

log ip = 

1 

+ 

cp = 

Ce ^ 


In order to determine C, consider 


But 



e' 



(See Example 1.) 



and, therefore, 


Example 4. Evaluate 

(97-5) F{a, j8) = x, where a ^ 0. 

Without loss of generality ^ may be assumed to be positive, 
since a change in the sign of merely changes the sign of the 
integral. Now 

(97-6) f cos 

op Jo 

and, since for a fixed « > 0, 

cos 

which is independent of /3, the differentiation under the sign is 
valid. 
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>7 

The evaluation of (97-6) is easy. For 

r'e-cos0xdx= ^sin3x-acos 

5/3 Jo «= + 

Hence, 

(a, /3) = r = tan-i - + C. 

J «“ + a 

But F{a, 0) = 0 and, since (97-5) defines a continuous function 
of 

lim F(a, ^) = 0 = tan-i - -r C. 

/ 3-*0 « 

Thus 

Consequently, 

(97-7) Fia =tan-i^, >0. 

a 

It follows from (97-5) that 
(97-8) F(0, 0) = 

and if it is demonstrated that (97-5) defines a continuous func- 
tion of a (for all a > 0 and for a fixed ^), then (97-7) will afford 
a means of calculating the integral (97-8). But, by breaking 
the interval of integration in (97-5) into subintervals of lengths 

(97-5) can be written as 
(97-9) F(a, /?) = 

and it is not difficult to show* that the numerical value of the 
* If the substitution z — z ‘i is made in the integral, the assertion 


follows almost immediately. 
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nth term of the series is less than -• Furthermore, the series 
is alternating and decreasing, so that the sum of the terms 
beginning with the (n + l)st is less than — which is inde- 

72 / I 


Fig. 77. 

pendent of a. Hence, the series (97-9) converges uniformly and 
thus defines a continuous function for a > 0.* Accordingly, 


F(0,/3) ^ ^ 

dx = lim tan"i - 
a 



if 

>0, 


if 

^ <0, 


= 0, if 

= 0. 

The function defiined by 

/• oo • 

I — 'da; is 
Jo a: 

discontinuous at 


^ == 0 (see Fig. 77). This integral is of importance in the theory 
of Fourier series. 


Example 5. As an example of an integral with a discontinuous 
integrand, consider 

(97-10) = 

Jo I — 

* It should be noted that the continuity of F (a, jS) (for a fixed does not 
ensure the uniform convergence of the integral (97-5). As a matter of fact, 
the integral is uniformly convergent if a ^ 0, but this has not been demon- 
strated above. Instead of constructing the series, one could prove the 
uniform convergence of (97-5) and thus deduce the continuity of i^(«, /3). 
This can be done with the aid of the second mean-value theorem for inte- 
grals. See, for example, H. S. Carslaw, Fourier Series and Integrals, 2d ed., 
p. 184. 
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1 - s’ 


hence, 

= fo + j^xlogxdx+ ■ • - 

n -n+1 

+ I s" log X dx + I 

Jo Jo 1 - s 

If it is established that 

lim R„ = lim — log xdx = 0, 

71 — > CO n — > ®o t/O -*■ ^ 

then 


log X dx. 


where the last step results from integration by parts. 

The proof that lim = 0 is accomplished without much 

n-i- » 

trouble if one notes that 


(97-12) 



log xdx ^ 


— — log X dx 


+ 



log X dx, 


where a is a positive number less than unity. Now 


r log xdx < a"+^ r dx, 

Jol-a:^ Jol-x’ 

and, since a < 1, the expression* on the right tends to zero 

as n — » CO. 


*NoteProb. 1 (j), Sec. 95. 
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The reader will show that , ' ^ is bounded ifO<a^x:<l 

and hence, the second integral in the right-hand member of 
(97-12) likemse tends to zero as « -> «> . This completes the 
proof of the validity of formula (97-11). 

The function 

-y- 


has been studied by Riemann and is called the Riemann zeta~ 
function.* Thus the value of I is “-f(2). 

PROBLEMS 

1. Verify the values of the integrals given below: 


(a) 


(&) 


( 6 ) 



a > 0 : 
a > — 1 ; 


' sin a; da; 




1+a^ 


a >0; 


= log Of > 0, jS > 0; 


' cos px dx 



0 . 


a > 0; 


2 . Let 


* See, for example, E, T. Whittaker and G, N. Watson, A Course of 
Modem Analysis, Chap. XIII. 
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Differentiate this integral with respect to a, and evaluate the resulting 
integral. Hence, show that 


P log (1 + ^ 

Jo 1+ a;’ 


dx 


2. Assuming that 


X 


2\a 


a > 0, 


is valid for complex values of qj ^ a -j- hi == where a > 0, show that 


Jo 2\r 


Set a = 0 and & = 1, and obtain the Fresnel integrals 

2V2 


^ so ^00 

I cos dx — I si 

Jo Jo 


sin X- dx 


4, Using the formula 


show that 


5. Show that 


X- dXf 



00 


dx 
e* — 1 


int: Integrate by parts, and use J da; = if jd >0. 

98. Improper Multiple Integrals. Let/(a;, y) be a function of 
two variables x and y which is continuous at every point of a 
two-dimensional region i2, bounded by a closed curve C, except 
at the point it}) where /(x, y) becomes infinite. The symbol 

(98-1) fix, y) dS, 

where dS is the element of area of the region R, is called an 
improper dovhle integral. 
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Let an arbitrary infinite sequence of closed curves Ci, C 2 , 
• • • , Cn, • • • be drawn in R in such a way that each curve 
Cn encloses the point ??) and w^here each curve lies entirely 
within the preceding one. Furthermore, let the greatest linear 
dimension of the region Rn enclosed by Cn tend to zero as n 



increases indefinitely (Fig. 78). Denote the closed region which 
is exterior to and interior to C by 

R - Rnj (n = 1, 2, • • • ) : 

then the function /(a;, y) will be continuous in the regions R — 
and the double integral 


will exist for every value of n. 

If 

n — > 00 

exists for an arbitrary choice of the regions then (98-1) 
is said to converge. It follows from the definition of the limit 
that the convergence of (98-1) means that for any € > 0 one can 
find a positive number b such that 

(98-2) y'> 

for every subregion R' of R which does not contain Q and which 
lies within the circle of radius d with center at Q. 
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K f(x, y) contains a parameter a, where a:,: < a < ai, ilien 
the convergent improper integral defines a iinietion of a. ilore- 
over, if the choice of the radius 5 of the circle is independent 
of the choice of a in (ao, a:}, then the integral 

dS 

will be said to converge uniformly. A uniformly convergent 
double integral defines a continuous function of a, and it may be 
integrated under the integral sign with respect to a. The 
differentiation under the integral sign is permissible if the 
derived integral, namely, 


dS 


converges uniformlj^ 

These considerations can be extended to cover the case of 
improper double integrals containing a finite number of param- 
eters. An extension of the definition of an improper integral 
to functions of more than two variables is likewise immediate. 

Thus, if /(x, y. becomes infinite at the point Q(|, tj, f), but 
is continuous at every other point of a three-dimensional region 
R containing Q, then the symbol 

(98-3) fjix, y, z) dV, 

w'here dV is the element of volume, is called an improper triple 
integral. If Rn (where n = 1, 2, • • ■ ) is a sequence of regions 
bounded by the closed surfaces Sn, which are constructed in a 
manner entirely analogous to the construction of the curves Cn 
in the definition of the two-dimensional case, then (98-3) is 
said to be a convergent triple integral provided that 

lim f f(x,y,z)dV 

71—}. GO — 

exists independently of the choice of the regions Rn- 

The following test, giving a sufficient condition for the con- 
vergence of an improper triple integral, is used frequently in 
applied mathematics. 

Test for Convergence. Let f(x, y, z) he a continuous function 
at every point P(x, y^ z) of the region R with the exception of the 
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point Qi^, fi, f), where f(x, y, z) becomes infinite. If there exists a 
positive constant A such that 

(98-4) \r^f{x,y,z)\<A, 

where r = {x — + {y — nY -f (2 — lY and n < 3, 

the integral 

(98-5) , z) 

is convergent. 

The proof of this test follows from the criterion of convergence 
analogous to (98-2). Indeed, if the integral (98-5) is to converge, 
then for an arbitrary € > 0, 


idF <e 

for every three-dimensional subregion R' (of R) not containing 
Q(|, 77 , f) and lying within the sphere S of radius b whose center 
is at Q. But if the inequality (98-4) is satisfied, then 

(98-6) fix, y,z)dV f ^ dV. 

Since B' is only a part of the region bounded by the sphere S, 
and since the integrand is positive, it follows that 

I 

The integral on the right of this inequality can be evaluated 
easily in spherical coordinates, since* 

A nZT r>w 


But if n'< 3, then the magnitude of the right-hand member of 
(98-7) can be made as small as desired by choosing the radius S 
small enough. It follows from (98-7) and (98-6) that 

\h,f(x, y, z) 


* See Sec. 49. 
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can be made as small as desired, and this establisiies the conver- 
gence of (98-5). 

The reader will show, by using a similar argument, that 
an improper double integral will surely converge if 

!/(^: y)'. < p’ 

where n <2, A is a positive constant, and r is the distance 
from P to Q. 

As an illustration of the application of the theory of this 
section, let it be required to calculate the gravitational attraction 
on a unit mass located at a point P{x, ?/, z) due to a distribution 



of mass of density p contained within the volume '7 (Fig. 79). 
Denote the coordinates of the points of the volume 7 by (^, t?, f) ; 
then the density p is a continuous function of and f and fhe 
element of mass dm of the body is 

dm = p dV, 

The attraction at the point P, due to an element of mass dm, 
is given by the inverse square law, namely, 

dm p(^? 

where r = + (y - - f)"* The components 
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of the force of attraction along the coordinate axes are* 

— £-Z_i — . y — V _ dm z — ^ 

hence the force X in the direction of the a:-axis is 
(98-8) Z = 

with similar expressions for the components of force in the direc- 
tions of the y~ and ^-axes. 

The variables of integration in (98-8) are rj, and so that 
the element of volume dV can be expressed as d^ dr] df. If the 
point P is outside the volume F, so that r never vanishes, then 
the integral (98-8) is proper. If, however, P is chosen within 
the body, then the denominator of the integrand in (98-8) 
vanishes when ^ = x, rj = y, and ^ = z, but it is not difficult 
to show that the resulting improper triple integral converges. 
Indeed; let the maximum value of p(^, rj, f) be A; then 

P . ^ - 

-y.2 /}. 

and, since the exponent of r is less than 3, the integral (98-8) 
vill surely converge. 

The potential y, z) at the point P due to a distribution 
of mass of density p is defined by the equation f 

(98-9) y, z) = 

and (98-9) is certainly convergent at all interior points if p 
is a continuous function. 

It is important to note that the maximum density A is inde- 
pendent of the location of the point P(rr, y, z), so that the integrals 
(98-8) and (98-9) converge uniformly for all values of the param- 
eters Xj y, and 2 :. Accordingly, the potential ^ and the com- 
ponents of force X, Y, and Z are continuous functions of x, y, 
and z throughout all space. 

* See p. 202. 
t See p. 203. 
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Since 


X - d r ij- 

dx 

it follows from (9S-S) that 


(98-10) 




which are precisely the expressions that one obtains by differen- 
tiating (98-9), under the integral sign, t\ith respect to the param- 
eters X, y, and z. The differentiation under the integral sign 
is clearly justified since (98-8) converges uniformly. Con- 
sequently, one can viite* 

(98-11) § = =7, f = 2. 

If the point P is outside the volume 7, the integrals (98-10) 
are proper and hence can be differentiated under the sign. Thus, 



vith similar expressions for — and But 
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and the expressions for — • and s^re similar. 


Hence, 


dz 

and a reference to (98-11) shows that 
(98-12) ^ ^ = 0. 


This is the celebrated partial differential equation of Laplace. 

If the point P is interior to the body, the differentiation of 
(98-10) under the integral sign is not legitimate, and the equation 
(98-12) is no longer satisfied unless p — 0. 


PROBLEMS 


1. Prove that the force of attraction at a point P, exterior to a homo- 

M 

geneous sphere, is F = •^; where R is the distance from the center of 

the sphere to the point P and M is the mass of the sphere. 

2. If the force of attraction exerted by an element of mass dm on a 

point is — where r is the distance from the element of mass to the 

point, find the attraction of (a) a homogeneous right-circular cone upon 
a point at the vertex; (6) a homogeneous right-circular cylinder upon a 
point on its axis. 

Am. (a) 27rkph{l — cos a), where h is the altitude and 2o; is the angle 
at the vertex; 


(6) 2'irkp[h -f- — \/(P -h hY + ], where h is the 

altitude and a is the radius of the cylinder, and R is the dis- 
tance from the point to one base of the cylinder. 

3. Find the force of attraction on a unit mass located at a point within 
the cavity of a homogeneous spherical shell. 

4. Find the potential due to a homogeneous spherical shell at all 
points exterior to the shell, and within the cavity. 

5. Find the potential at the points on the axis of a homogeneous cylin- 
drical shell. 


99. Gamma Functions. An interesting function, which pro- 
vides a generalization of the factorial, is defined by the improper 
integral 
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(99-1) T(a) = ^ dx, where a > 0^ 

and is called the Gamma function. 

If a is a positive number less than uniiy. the integrand of 
(99-1) becomes infinite at the lower limit x = 0, so that it becomes 
necessary to investigate the behavior of the integral at both 
limits. Accordingly, (99-1) vdU be written as the sum of two 
integrals, namely, 

(99-2) r(a) = Mx 

the second of w^hich has a continuous integrand for all values of 
X 1. Moreover, this second integral converges if a > 0 
since’* 


lim . = lim ; == 0. 

If a > 1, the fiirst integral is proper, since its integrand is 
continuous. It remains to investigate the beha\dor of the 
integral 

(99-3) 

when 0 < a < 1. Now 

lim = 0, if A -f- a — 1 > 0, 

and this condition is surely satisfied if 1 — a < fc < 1. It 
follows from the corollary to the theorem of Sec. 95 that (99-3) 
is a convergent integral. 

It is also clear that (99-1) diverges if a 0, so that (99-1) 
defines a function for positive values of a only. However, 
it is possible to define the function r(a) for negative values of a 
with the aid of the recursion formula w^hich will be developed 
next. 

If a > 0, then it follows from (99-1) that 
(99-4) r(a 4-1) = fa^e-^dx. 

* See corollary to Theorem 1, Sec. 93. 
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Integrating the right-hand member of (99-4) by parts gives 

dx = -x^e~ -h a f dx 

0 0 Jo 

= ar(o'). 

Thus, 

(99-5) V(a + 1), = aVia). 

But 

r(l) = £’°e--dx = 1, 

so that when a = 1, the formula (99-5) becomes 

r( 2 ) = 1 • r(l) = 1. 

Setting a = 2, 3, • • • , n gives 

r(3) - 2 r( 2 ) = 1 * 2 , 
r(4) = 3r(3) = 1 • 2 • 3, 


r(n) = (n - - 1) = (n - 1)!, 

= nl 

Hence, the formula (99-5) enables one to compute the values of 
r(o:) for all positive integral values of the argument a. 

If by some means (for example, by using infinite series) the 
values of r(ai) are obtained for all values of a between 1 and 2, 
then, with the aid of the recursion formula (99-5), the values of 
r(a) are readily obtained when a lies between 2 and 3. Knovdng 
these values, it is easy to obtain r(a:) where 3 < oj < 4, etc. 
The values of r(a) for a lying between 1 and 2 have been com- 
puted* to a high degree of accuracy, so that it is possible to find 
the value of r(a) for all o: > 0. 

It remains to define r(a) for negative values of a. The 
recursion formula (99-5) can be written as 

(99-6) T(a) = 

The formula (99-6) becomes meaningless when a is set equal to 
zero, since 

limr(o') = +00 and limr(a:) = — oo. 

cc — >0 + 0 £— >- 0 — • 

* Small table is found in Peirce’s “Table of Integrals/’ p. 140. 
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It follows from (99-6) that the function r( — a) is discontinuous 
when a is a positive integer. 

If any number — 1 < a < 0 is substituted in the left-hand 
side of (99-6), the right-hand side gives the value of r( — a), 
since the values of oj + 1 lie between 0 and 1, and T{a) is known 
for these values of a. Thus, 

= r(-o.9) 

In this manner the values of r (a) for —1 < a < 0 can be com- 
puted. Knovdng these values and using the recursion formula 
(99-6), the values of r(a) for 
~2 < a < —1 can be obtained, 
etc. The adjoining figure rep- 
resents the graph of r(Q!) (Fig. 

80). 

It was observed that 
T(a + 1) = a! 

when o: is a positive integer. 

This formula may serve as the 
definition of factorials of frac- 
tional numbers. Thus, 

r(l) = 0! = 1. 

This section will be concluded with an ingenious method* of 
evaluating 34 !. Now 



If the variable in this integral be changed by the transformation 
X = the integral becomes 

(99-7) 34! = 

Since the definite integral is independent of the variable of 
integration and is a function of the limits, 


* See also Sec. 97, 
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(99-8) M'- = 

Multiplying (99-7) by (99-8) gives 

(HO^ = 

which can be written as a double integral 

(99-9) 

In order to evaluate (99-9), transform it into polar coordinates 
by setting z — r cos 6 and y — r sin d. The element of area 
dy dz becomes r dr dd, and (99-9) becomes 

But 

7f 

f sin^ d cos® B d6 = 

Jo lb 

and 

£■ 

The latter integral is evaluated by integration by parts. There- 
fore 


or 



2 


It can be shown with the aid of the recursion fornaula that 


PROBLEMS 

1 . Compute the values of r(o:) for everj'- integer and half integer from 

0 to 5 by using the relations 1(1) = 1 and r(M) = Pbt the curve 

y = rCoj) with the aid of these values. 

2. The beta-function B (m, n) is defined by the integral 

B(m, n) = dx. 
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If X is replaced by y- in Tin) = di\ there results 

Till) = 2 ; 

Using this integral, form 

X QC 

^ dx I dy. 

Express this product as a double integral, transform to polar coordinates, 
and show that 

B(?? 2 j n) ~ B(n, m) = . . 

-T n) 

3. Show, by a suitable change of variable, that (99-1) reduces to 


4. Show that 

Jo 

and justify the differentiation of (99-1) under the integral sign. 
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100. Criterion of Approrimation. It is already known* that a 
suitably restricted function f{x) can be represented in a series 
of ascending powers of x. The restrictions imposed upon f{x) 
are quite severe inasmuch as it is assumed that the function 
not only possesses derivatives of all orders, but also that the 
remainder in the expansion converges to zero uniformly.! It 
is obvious that a function that is capable of a power-series 
representation can be approximated arbitrarily closely in a given 
interval by a polynomial of sufficiently high degree. The 
criterion of the closeness of approximation in this case consists 
of the requirement that the numerical value of the deviation of 
the values of the function from those of the polynomial (that 

is, the remainder R„{x) =f{x) — can be made less 

than some specified amount for all values of x in the given 
interval. 

The question naturally arises whether it is possible to represent 
a given function /(x) by a trigonometric polynomial of the formj 


( 100 - 1 ) 


do 

2 


; COS 


where dk and bk are real constants so selected as to satisfy some 
criterion of the goodness of approximation. 

It should be observed that since every term in the right-hand 
member of (100-1) is a periodic function of period 2ir, Sn{x) 


* See Chap. IX. 
t See Sec. 82 . 

} The reason for writing the constant term as — will appear in the next 

2 

section. 


378 



fiOO FOURIER SERIES 379 

is also periodic.* Consequently, only periodic functions f{x) 
of period 2t can be approximated by a pohmomial of the form 
(100-1). Or, what amounts to the same thing, one can restrict 
the problem of approximating a nonperiodic function f{x) 
to some intert^al of mdth 2ir and define the function /(a:) outside 
this interval so that it is periodic. It will be assumed from this 
point on that the problem of approximating f{x) by a trig- 
onometric poljmomial is confined to the interval (—-jr, tt) and 
that outside this interv’^al the function fix) is defined by the 
equation /(rr + 2t) = fix). Of course, any interv’-al (a. a + 2t) 
will do equally well. 



In formulating the problem of approximating fix) by a trig- 
onometric polynomial Snix), one could demand that the coeffi- 
cients ajc and be so chosen as to satisfy the requirement that 
the difference d^ix), between the values of the function fix) 
and the polynomial Snix), does not exceed a prescribed amount 
for all values of rc in the interval (— x, x). However, such a 
criterion would regard the dotted curve shown in Fig. 81 as 
constituting a better representation of the function fix), shown 
by the solid line, than the wavy dotted line approximating the 
same function /(a:) in Fig. 82. For it is clear that the maximum 
deviation of the approximating function shown in Fig. 81 is 
less than the corresponding maximum deviation shown in Fig. 82. 

It appears more reasonable to set up as a criterion for the 
goodness of approximation the magnitude of the integral of the 
absolute value of 8nix), namely, 


dXj 


* A function is said to be periodic of period a if /(a?) = /(a; + a). 
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since thds integral represents the shaded area between the ounces 
S^ix) and f{z). The closer the approximating curve lies to 
fix), the smaller the magnitude of the integral will be. However, 
a study of integrals containing absolute values of functions in 
the integrand is quite difficult, and it is customary to consider 
the integral of the square of 5„(x) instead of the integral of its 
absolute value. Accordingly, it vill be agreed that the “best” 
approximation for the function /(x) by means of a trigonometric 
poljmomial S„(x) is that polynomial in which the coefficients 
an and h are so selected as to make the magnitude of the integral 

(100-2) I„ = f^5n(x)]^dx 

= I f(z) — ^ ’ cos , bs sin 1 dx 


a minimum. 

Therefore, the problem of determining the coefficients in 
(100-1) is reduced to that of minimizing the function h of 
2re 4- 1 variables an and bn. The follovdng section is concerned 
with this problem of minimizing the integral (100-2). 

101. Fourier Coefficients. Let fix) be an integrable* (and 
hence bounded) function defined in the interval 
and let Srfx) be the trigonometric polynomial 


do 


cos : sin kx), 


where the coefficients an and bn are to be selected so as to render 
the integral 


( 101 - 1 ) 



cos . 


a miniTYnini . 


*See p. 110. 
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Calculating the partial derivatives gives 


(a;: COS kx -r bk sin kx 


0 

1 

to 

k = l 

cos 

-r bk sin kx, J cos kx dx. 




= L 2. • • • , n,\ 


ft 2 <“ 

A: = l 

: COS kx 

-r bk sin kx^ J sin kx dx. 




(/: = h 2, . . . , . 

But it is 

known that 




J cos kx cos mx dx = 0, 

if 

^ VI ; 


= 

if 

k = m 9^ 0; 

(101-3) 

J*"" sin kx cos mx dx = Q: 




^ J*"" sin kx sin mx dx = 0, 

if 

k 7^ ni; 


= TT, 

if 

k = m 7^ 0: 


SO that carrying out the integrations indicated in (101-2) gives 



[k = 1, 2, , n); 

{k = 1, 2, • • • , n). 


The necessary condition for a minimum of In (see Sec. 89) 
requires that these derivatives vanish, and this leads tc the 
following values for the coefficients: 


f{x) cos kx dx, 



f{x) sin kx dxj 


{k = 0, 1, 2, • ■ • , n); 

(fe = 1, 2, • • • , ?!•). 


(101-5) 
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It follows immediately from (101-4) that the coefficients 
and bk so obtained make (101-1) a minimum, since 


_ 3-In 
dal dbl 


(fc = 1, 2, • • • , n), 


whereas all the mixed derivatives of the second order vanish. 
The constants a* and bk defined by the formulas (101-5) are 
called the Fourier coefficients of the function f(x). 

Some insight into the character of the approximation of a 
fimetion f(z) by the trigonometric polynomial can be gained 
by expanding the integrand in (101-1) and integrating those 
terms which are free of f{x). The result is 




sin kx dx 


k-l 

which, upon substitution from (101-5), gives the important 
formula for the magnitude of the integral of the square of the 
deviation, 

(101-6) I„ = 


Since I„ is never negative and the sum (al -f 6|) is an 

increasing function of n, it follows that J„ is a monotone-decreas- 
ing function of n. Consequently, the approximation of fix) 
by the trigonometric polynomial 



(tti cos kx + bk sin kx), 
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where the eoeflEicieiits are determined by (101-5), improves with 
the increase in the number of terms of the pol 3 'nomial. 

Moreover, it follows directly from (101-6) that the series 
of the squares of the Fourier coefficients, 


(101-7) 


converges whenever f(x) is an integrable function. For, since 
In ^ 0, it is evident that 


(101-8) g - ]- dx. 

TT 

Now the left-hand member of the inequality (101-8) is precisely 
the nth partial sum of the series (101-7), and since it is bounded, 
the convergence of the series (101-7) fellows directly from 
Theorem 1, Sec. 62. Furthermore, the terms of any convergent 
series form a null sequence, so that the Fourier coefficients of 
any integrable function f(x) tend to zero with increasing n. 

It was shown* by Liapunoff, in 1896, that the limit of h 
as n increases indefinitely is zero, so that the following remarkable 
formula is true whenever f{x) is an integrable function. 



However, the fact that the integral of the square of the devia- 
tion tends to zero when the number of terms in the trigonometric 
polynomial is increased indefinitely does not establish the 
. convergence of the Fourier series 


(101-9) cos kx -f bk sin 

In fact, if f(x) is merely an integrable function, the Fourier 
series may fail to converge either at some points of the interval 

* See Whittakbs, E. T., and Watson, G. N., Modem Analysis, p. 170. 
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or even in the entire interval (— tt, tt). Even if the Fourier 
series (101-9) does converge, its sum is not necessarily /(rr). 

In order to establish the convergence of (101-9), it is necessary 
to impose some additional restrictions on the function }{x). 
There are several sets of sufficient conditions which will ensure 
convergence of the Fourier series. One of the most celebrated 
of these is due to Dirichlet, and it is set forth in the following 
section. The discussion of the next section makes use of the 
following theorem. 

Theorem. IJ fix) is an integrable function in the interval 
a < X S P, then the integrals J'V(^) cos nx dx and sin nx dx 

tend to zero as n increases. 

If the interval (a, P) is of length 27r, then it follows from (101-5) 
that* 


j^f{^) cos nx dx = f{x) cos nx dx = a^iTr, 

and it was noted above that the Fourier coefficients of an inte- 
grable function form a null sequence. If the interval (a, /3) 
is of length less than 2‘jr, define the function (p{x) in the following 
W'ay. Let (p{x) ^ f{x) in the interval (a, ff), and let (^(a;) = 0 
at all other points of the interval of length 2x. Then 



cos nx dx 


= (p{x) cos nx dx = UnTT, 


and it folloTvs as before that ^ 0 as n co . If (a, /?) is an 
interval of length greater than 2x, then it can be broken up into 
a finite number of intervals of lengths less than or equal to 27r. 
Then the integral 

cos nx dx 

can be expressed as the sum of a finite number of integrals of the 
type considered above, each of wffiich tends to zero as oo . 
The proof for the integral 


is entirely similar. 



sin nx dx 


* It will be recalled that the function f{x) is assumed to be periodic of 
oeriod 27 r. 
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102, Conditions of Dirichlet- 

Theorem. Let f{x) be a Junction defined arbitrarily in the 
interval — tt ^ :r < tt, and outside this interval defined by the 
equation f{x + 2t) = f(x). If f(x) has a finite number of points 
of ordinary discontinuity and a finite number of maxima and 
minima in the interval —tt < a: < tt, then it can be represented by 
the series 

^ , cos kx + bk sin kx), 

with 

= - I f{t) cos kt dt, 

tJ —TT 

6* = - I fit) sin kt dtj (fc = 0, 1, 2, • * * ), 
which converges at every point x — Xq of the interval to the value* 

/(3/0 + ) +/(3?o — ) 

2 

The restrictions inoiposed upon the function fix) in this theorem 
are known as the Dirichlet conditions. 

In order to establish the theorem it is necessary to show that 
for any x in the interval 


where 


(102-1) Snix) == -^ cos : sin 


*If/(a:) is continuous at the point a; = a;o, then/(a:o4’) ==/(a;o— ) fixo), 
so that at all points of continuity the series converges to f{x). At the 
points of ordinary discontinuity it converges to the arithmetic mean of the 
values of the right- and left-hand limits. 
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Substituting the values of aj and bt in (102-1) gives 


nix) = i r f{t) 




fc=l 


I + 2 ~ 


The expression appearing in the bracket can be summed with 
the aid of the trigonometric identity* 




sin 


so that Sn(x) can be written as 


■d. 


Sn(.X) = 

Setting t — X = 2u, gives 

IT 

(102-2) ;S„(a;)=iJ_ 


sin (2n + 1) 


2 sin 


t — X 


dL 


IT— a 
2 


Sin ■ 




Thus the study of the limit of Sn(x) as oo is reduced to 
the study of the behavior of an integral of the form 


^ Proof: 

. u/l \ 

sm -I - + cos -w + cos 2w + • • • + cos nu ] 


j. 

(«+^) 
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(102-3) 



mu 
sin u 


dUj 


when m is allowed to increase indefinitely. This integral is 
known as the integral of Dirichlet, and a study of it reveals that 
the linoiting value of (102-2) as =c is precisely equal to 
/4[/(^+) +/(a;“)]. Unfortunately, a detailed discussion of 
the integral (102-3) is very involved,^ and for this reason the 
convergence of (102-2) vill be established under the hypothesis 
that fix) is a differentiable, and hence, continuous, function. 

Consider first the function Fix) = 1. All the Fourier coeffi- 
cients, vdth the exception of ao, of such a function vanish, so 
that (102-2) gives the identity 


T—X 

^ 1 r ^ sin (2n + l)u 
5rJ-r-x sin It 


which is valid for all values of n. If both sides of this identity 
are multiplied by /(x), there results 


(102-4) 


IT ~ iff 



Subtracting (102-4) from (102-2) gives 


(102-5) 

TT 


sin (2n 


Now the expression appearing in the bracket of the last integral 
is a continuous function of u, except, possibly, when = 0. 
But 


lim* 


sin u 


* Knopp, K,, Theory and Application of Infinite Series, p. 356. 
Caeslaw, H. S., Fourier's Series and Integrals, p. 207. 
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Since 


lim 


u 


= 1 . 


^0 sin u 

Hence, if the value of the function 

+ 2u) — 


F{u) ^ 


2u 


sin u 


is defined at “ 0 by the equation 

i^(0) ^ 2r{:x), 

then F{u) is surely bounded. But the theorem of the preceding 
section states that for any integrable function (p{u) 

lim f%(u) sin nu du = 0, 

71— » 00 

SO that the integral in (102-5) approaches zero as n— » oo. 
Accordingly, 

lim Snix) = fix). 

n—^ 00 

The foregoing proof can be extended to include the case of a 
function vnth a finite number of ordinary discontinuities if 
the function possesses a derivative at every point where it is 
continuous- 

103. Orthogonal Functions. A set of continuous functions 
(103“1) j V/2ix)j * * * 7 '^nix)} 

which do not vanish identically in the interval a < x < b, is 
said to be orthogonal wdth respect to the interval (a, b) if the 
functions Uiix) satisfy the relations 

(103-2) j\i(x)Ujix) dx — 0, if ^ ^ j. 

For i = j, (103-2) becomes 


tiix)]^ dx = c% 


where c| certainly is not zero. 

If each of the orthogonal functions Uiix) be divided by Ci 
there will be obtained a system of normal orthogonal functions, 
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which are characterized by the property that 

(103-3) Viix)vj(x) dx = Oj if 2 * j, 

= 1, if i = i. 

Consider a set of normal orthogonal functions and 

assume that an arbitrary function f{x) can be expanded in a 
series 

(103-4) fix) = + a^v^ix) QnVnix) + 


which can be integrated term by term. ]Multipl 3 dng both sides 
of (103-4) by Vjix)f and integrating term by term between the 
limits a and 6, 


dx = dxj 

which, by \drtue of (103-3), gives the formula 

(103-5) ai = j*y(x)vi(x) dx, {i = 1, 2, 3, • • • )• 

The numbers ai are known as the Fourier coefficients of the 
function /(a;) associated with the system of normal and orthogonal 
functions 

. Vnix), 

The set of functions 

1 cos x sin X cos 2x sin 2x cos nx sin 


is obviously a normal orthogonal set in the interval (—tt, ^). 

Instead of approaching the subject of the expansion of arbitrary 
functions in a trigonometric series with the aid of the criterion 
of Sec. 100, one could begin by assuming that it is possible to 
expand the function fix) in a series 
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(103-6) f{x) = cos kx + hk sin 


which can be integrated term by term in the interval (— tt, tt). 
MiiltipMng both sides of (103-6) by cos and integrating 
term by term with the aid of the formulas (101-3), gives 

” I /(^) kx dXj (Jo = 0, 1, 2, • • • ). 

7rJ-r 

Similarly, multiplying (103-6) by sin mx, and integrating the 
resulting series term-vise, furnishes 

1 f’" 

= ~ I /(^) sin kx dx, (k = 1, 2, 3, 

TOj -IT 

Thus, the hypothesis that the function f(x) can be expanded in 
a trigonometric series (103-6) that can be integrated term by 
term leads to the same values of the coefficients as those obtained 
earlier by an entirely different method. 

It is seen from the foregoing that the discussion of Secs. 100 
and 101 constitutes a very special case of the problem of repre- 
senting an arbitrary function f(z) by a series of orthogonal 
functions. 

104. Expansion of Functions in Fourier Series. This section 
contains some illustrative examples of expansion of functions, 
satisfying the Dirichlet conditions in the interval (-tt, t), in the 
series 

(104-1) ^ cos nx + hn sin nx), 


where the coefficients an and bn are given by the formulas 


(104-2) 

1 

cin = - \ f(x) cos nx dx. 



and 


(104-3) 

1 f'' 

= " 1 f(x) sin nx dx. 
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Illustrative Example 1. Expand /(x) = x in Fourier series in 
the interval — v S x < v. Calculating the coefficients «« and 
gives 


and 


Hence, 


1 f" . 

= - I X SI 


X cos nx dx = 0, 


sin nx dx = — cos ut. 
n 


= 2[(— K cos tt) sin x + { — cos 27r) sin 2x 

+ (““M cos Stt) sin : 


or 


. sin 2x , sin dx \ 

= 2[smx- — + -^ j. 

In this particular case only the sine terms remain. It may be 
noted that whenever the function /(x) is an odd function, that is, 
when/(— x) = — /(x), then = 0, forn = 0, 1, 2, • • • , since, 
for such a function, 



cos nx dx 



cos nx dx. 


Similarly, if/(x) is an even function, that is, when/('-x) = /(x), 
then hn = 0, forn = 1, 2, 3, * • * , since 


sill nx dx = sin nx dx, 

so that the function would be represented by a series of cosine 
terms. 

If in the foregoing illustration the first four terms be plotted by 
composition of 

2/ = 2 sin X, y = —sin 2x, y — % sin 3x, y = — sin 4x, 


the curve 


2 / = 2 sin X — sin 2x + % sin dx — sin 4x 

is obtained. It is represented on Fig. 83. As the number of 
terms is increased, the approximating curves approach y = x as a 
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limit for all values of —Tr<x<T, but not for x = ±7r. 
Since the series has period 2tj it represents the discontinuous 

Ten fer/77s->A\ 


S/x Terms 


Four terms 



Fig. 83. 


function, shown in Fig. 84 by a series of parallel lines. It should 
be noted that each term of the series is continuous and the func- 



Fig 84. 


tion from which the series was derived is continuous, but the 
function represented by the series has finite discontinuities at 
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X — ± {21: -f l)7r. At such points the series converges to zero 
which is one-half the value of the sum of the right- and left-hand 
limits. 

Illustrative Example 2. Develop f{x) in Fourier series in the 
interval (— tt, tt), if 


Now 


f{x) = 0, for —7r<x< 0, 
= TT, for 0 < X < X. 


G'O == — 


1 r 

3n = “ I X 

^Jo 

h ^ r 

On — - \ X 
TTJQ 


COS nx dx — 0, 


sin nx dx — -(1 — cos nx). 

71 ^ 


The series is then 


^ sin 3x j sin . 

The graph of /(x) from — x to x consists of the x-axis from 
—x to 0, and the line AB from 0 to x (see Fig. 85). There is a 



finite discontinuity for x = 0. For x = 0 the series reduces 
to which is equal to half the sum of lim/(0 — e) and lim/(0 + e). 
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It may be observed from the series that every approximation 

cur\"e will pass through the point ^0, The figure shows the 

first, second, third, and fourth approximation curves vrhose 
equations are 


TT , ^ ! o/ • f sin 3x\ 

= ^ + 2 sin X, y = - + 2{ sin x d ^ h 

sm , sin 

^ 2 ‘ -y--- ■ + 

as well as the graph of /(x). 

"TT 

At X == ±Tt the series reduces to and again every approxi- 
mation curve gives this same value for the ordinate at ± 7 r. 
This value is one half the sum of /(— 7r+) and/( 7 r— ). 

Illustrative Exam'ple 3. Let/(x) be defined by the relations 

/(X) = “T, if -T < X < 0, 

== X, if 0 < X < tt; 

then the Fourier coefficients for/(x) are given by 


dx = — i —Tdx 


(\dx]=U-^^ + ^ 
Jo J A 2 , 




/(x) cos nx dx ■■ 


if r r 

' J 'axdx -j- J X cos nx dx 

cos mr 1 


^ sin nx dx = sin nx dx + J* x sin nx dx 


zl ut — - cos mr 

-(1 — 2 cos mr), 
n 
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Therefore, 


'IT 2 

4 TT 


2 cos Bo; ^ 2 cos ox 
TT 3- TT 5^ 


. sin 2^ 3 sin 3a: sin 4x , 3 sin ox 

+3=“*-— + -3 r-+-6— 

When X = 0, the series reduces to 

1 



which must coincide with (see Fig. 86) 


Thus, 


Hence, 


TT 

I 





j, 

52 







Also for X = ±ir, the series gives 
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since 


= 0 . 

This example suggests the use of Fourier series in evaluating 
sums of series of constants. 

PROBLEMS 

1. Show that 


nx 


2, If 


then 


f{x) = — aj, for 

= 0, for 


-T < a; < 0, 
0 < a; < tt; 


cos {2n — 1} ( — 1)” sin nx 

{2n ~ 1)2 


3. If 


then 


f{x) — 0, for 

= sin X, for 


— TT < a; < 0, 
0 ^ a; <ar; 


1 



cos 2nx 


1 . 


4. If /(a;) = in the interval (0, 27r), then 




- 


T 


1 



cos nx 

1 + 7^2 



n sin nx 
1 + 7Z2 


6. Deduce from Prob. 1 that 


12 * 


71 = 1 



§106 


FOURIER SERIES 


397 


6. Show that 


sm Tra 

COS <xx cos ' 

Tra 


if — TT ^ X St, 

7. Deduce from Prob. 6 that 



n = l 

8. Deduce from the expansion oif{x) = re + in Fourier series in the 
interval ( — tt, t) that 





9. Expand x sin x and x cos a; in Fourier series in the interval (0, 2t), 

10. Find the Fourier series expansion for fix), ii 

fix) = for -TT < X < ^7 



106. Sine and Cosine Series. The Fourier expansion for fix) 
in {—T, t) has the form (104-1), in which the coej95cients Un and bn 
are given by (104-2) and (104-3). As previously obser\^ed 
(Sec. 104), if fix) is an even function, (104-1) 'reduces to a series 
containing only cosine terms; and if fix) is an odd function, 
(104-1) reduces to a series containing only sine terms. Now 
suppose that it is desired that fix) be expanded in a Fourier 
series which vdll be used for the interval 0 to x only. In that 
case it is frequently convenient to obtain the expansion in terms 
of sines alone or in terms of cosines alone. For this purpose 
define 


Fix) 

for 

0 < a; < TT, 

III 

for 

— TT < a; < 0, 


so that Fix) is an even function identical with /(a;) in 0 < x C, t. 
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For an even function: 


= - I F(a*) sin nx dx 

— 3r 

= i J* F{x) sin nx dx + J F(x) sin nx da; j 

= - — I F(— a:) sin (— na;)(— dx) + j F(x)sin?ixdx 
art Jo Jo 

= - — I F(x) sin nx dx + I F(x) sin nx dx = 0, 

®'L Jo Jo 


n 

Tl Jo 


F(x) sin nx dx + j F(x) sin nx dx = 0, 


if C"" 

= “ I Fix) cos nx dx + I Fix) cos m dx 
TrLJ-TT Jo 

iT 

= - I F(a;) cos nx dx + I Fix) cos nx dx 
^LJo Jo 

2 C" 

= - j Fix) cos nx dx. 
ttJo 


Fix) cos nx dx. 


Hence, in the expansion of Fix) in the interval —t<x<t only 
the cosine terms appear. Moreover, Fix) is identical with fix) 
for 0 < X < TT. Therefore,* 

(105-1) fix) = ~ + ai QOS X + a 2 oos 2x + • • • + an cos nx 


in the interval (0, tt), -where 


(105-2) 


2 f" 

= - J 

^Jo 


fix) cos nx dx. 


Similarly, if Fix) be defined so that 
~/(^) for 


0 < X < r, 


Fix) = —fi—x) for — TT < X < 0, 

* If f(x) has a iSnite discontinuity at the point x = xq, then the left-hand 
member of (105-1) is defined to be ^ 
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then the a„ all vanish and 

(105-3) fix) = bi sin a; -h 62 sin 2a: -h - -f- b„ sin nx 

where 

(105-4) sin nx dx. 

Thus f{x) can be represented in the interval 0 < a; < tt by either 
(105-1) or (105-3). Frequently one series is more desirable 
than the other. 

frx) l/rjci 


TT 




Fig. 88. 


Example. As has been determined already (see Example 1, 
Sec. 104), the expansion for/(a;) = aj in a sine series is 


= 2^sir 


sin2x sin3x 

2 3 


This series represents /(a;) = x in the interval (—tt, tt). If one is 
interested in the values of the function in the inters- al (0, x), the 
same function can be expanded in a series of cosines. 

In fact, in the interval (0, x), 


X 4/ cos X 

^ ” 2 xV 


cos 3a; cos 5a; 


=?r 

ttJo 


cos nx dx = ^[C*” I)** “ 


and 



400 


ADVANCED CALCULUS 


§106 


The sine series represents the odd function shown in Fig, 87 
and the cosine series the even function in Fig. 88. The two 
graphs are identical in the interval (0, tt ). 

PROBLEMS 

1. Show that if c is a constant, then, in 0 < x < tt, 

4 /. sin 3a; , sin 5a; , \ 

== c-l sin a; + I • 


2. Give sine and cosine developments of y = x sin x in the interval 
(0, tt), 

3. Show that, in (0, tt), 

a;2 ^ r:] ( IL - ^ ) sin a; - ^ sin 2a; + ( ^ ) sin 3a; 

— Sin 4x + 

4. Prove that if f{x) is any function of x, it can be expressed as the 
sum of an even function of x and an odd function of x, 

TT TT 

5. Show that if /(a;) = a; for 0 < a; < -^ and /(a;) = tt — a; for - < a; <7r, 
then 


i 2a; , cos 6a; , cos 
H r 


6. Show that 



cos ^ 


<X <T, 


7. Find the expansion in the series of sines, if 


= - x), 


- < X < 
2 


TT. 


8. Expand /(a;) = e® in the series of cosines in the interval (0, x), 



§106 


FOURIER SERIES 


401 


106. Extension of Interval of Expansion. Tlie metliods devel- 
oped up to this point restrict the interval in which /(x) can be 
expanded in a Fourier series to (— x). In many problems 
it is desirable to develop /(x) in a Fourier series which will be 
valid over a wider interval. In order to obtain an expansion 
w’'hich will hold for the inter^^al {—1,1), change the variable by- 

replacing X by Then /(x) = can be developed in a 

TV 

Fourier series in z. 


i sin nz, 


in which 


and 


fln = - I f[ — ] cos nz dz 


= - I /( ~ ) sin ns dz. 


The expression (106-1) will be valid for —tKzKtt, but 
z = ^ so that (106-1) becomes 


. 0-0 . flTTX 

(106-2) f(x) = -^ In. cos 

Also, 

= tj' f(^ “ J J* 

and 

Example. Develop f(x) in Fourier series in the interval 
(-2, 2), if/(a:) = 0 for -2 < x < 0, and/(x) = 1 for 0 < x < 2. 
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Here 


1 / nrirx . , riTTX ^ \ 1 . 

= K j-2° • ^ + X 1 ■ ^ 

Therefore, 



TZ 


. 5'7rX 

in 


PROBLEMS 

1. The expansion of/( 2 :) is desired for 0 < a; < Z. If i^(a;) = f(x) for 
0 < X <l and F{x) = — /(— x) for — Z < a; < 0 (that is, F(a:) is defined 
as an odd function), show that the expansion of F{x) and fix) for 
0 < a; < Zis 


where 

2 C\, . . mrx 

- i j/« “ — 

Ji (pix) = fix) for 0 < a; < Z, and <pix) = fi^x) for — Z < a; <0 (that 
is, (pix) is defined as an even function), show that the expansion of 
(pix) Sind fix) for 0 < a: < Z is 


mrx 


n = l 

where 


= Y fix) cos ^ dx. 
z Jo z 

2. Using the results of the preceding problem obtain the sine and 
cosine expansions of the following functions: 

ia) fix) = 1 in the interval (0, 2); 

(&) fix) = X in the interval (0, 1); 

(c) fix) = x^ in the interval (0, 3). 
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3. Expand /(s) = costtx in the inten-al (—1, 1). 

4. Expand 


/W = K-x, if 0 <x <}4, 

= x - if }i <x <1, 

in- the series of sines. 

6. Find the expansion in the series of cosines, if 

fix) =0, if 0 < a; < 1, 

/ = 1, if 1< X < 2. 

Expand /(a;) = la;| in the series of cosines in the interval ( — 1, 1). 

7. Show that the series 


1 . 27nrx 
- sin — 
n I 


represents — a; when 0 < a: < L 

Find the expansion in the series of cosines, if 

f{x) = 1, when 0 < x < -nr, 

= 0, when t < x < 2w. 

107. Complex Form of Fourier Series. The Fourier series 


(107-1) f(x) = -^ .cos 6n sin ' 

with 

a„ = - f fit) cos nt dt, = - j fit) sin ni dt, 

—IT 

can be "written "with the aid of the Euler formula* 

(107-2) = cosu + i sin u 

in an equivalent form, namely, 

(107-3) fix) = 5) 

n= — 00 

where the coefficients c„ are defined by the equation 
(107-4) On 


* See Sec. 84. 
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The index of summation n in (107-3) runs through the set of all 
positive and negative integral values including zero. 

The equivalence of (107-3) and (107-1) can be established 
in the following manner. Substituting from (107-2) in (107-4) 
gives for n > 0 

if' 

Cn = ^ I \nt — i sin 7it) dt 

cos sin 


A similar calculation for < 0 gives 


while 


Now (107-3) can be written in the form 


n = l 71 = 1 

Making use of the expressions for the c„ just found gives 



n = l 


Recalling that 

giu = 2 cos w and 

gives 


In cos nx + hn sin nx), 

71 = 1 

which establishes the identity of (107-3) with (107-1). 
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PROBLEM 

Show that the Fourier series in the interval (— /, 1) can be written in 
the form 

tUTZ 

Cne ^ 

where 

Cn = — dt 

108. Differentiation and Integration of Fourier Series. It was 
proved in Sec. 101 that the Fourier coefficients of any integrable 
function defined in the interval (— tt, tt) form a null sequence. 
A more precise bound for the magnitude of the Fourier coeffi- 
cients can be obtained if the function /(a;) satisfies the conditions 
of Dirichlet in the interval (-“‘tt, tt). The requirement that 
f{x) have only a fioiite number of maxima and minima is equiva- 
lent to saying that the interval (— tt, tt) can be divided into a 
finite number of subintervals in each of which the function is 
monotone. Consequently, 

(108-1) = ^ I f(x) cos nx dx 

can be expressed as the sum of a finite number of integrals of the 
form 

(108-2) cos nx dx, 

in each of which /(rr) is a monotone function. 

The application of the second mean- value theorem for integrals 
(Sec. 37) to (108-2) gives* 

J^V(^) cos nx dx = /(^+) cos nx dx + /(b — )/; cos nx dx 

_ /(a+)(sin n^ — sin na) 
n 

/(b — )(sin nh — sin nj) 
n 

* The symbols /(a 4-) and /(b— ) are used instead of f{a) and /(6) since 
the function may be discontinuous at the end points. 
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Now the numerators of these fractions are bounded, so that 

h 

f{x) COS nx dx 

Since (108-1) is expressible as the sum of a finite number of 

integrals of the form (108-2), it is clear that a„ is of order* i- 

An^ entirely similar argument can be carried through for 6^. 
This proves the following theorem: 

r Fourier coeffiderds and of a function 

Jut-mng the conditions of Dirichlet in the interval (-^ x) satisfy 
the inequalities ’ 


M 


and 


n 


where M is a 'positive number independent of n. 

If the^ function f{x)j defined in the interval —t:^x < t 
IS periodic and has the derivative which satisfies the conditions 
0 Dirichlet in the same interval, then the Fourier coefficients 

are of order For, 

1 

— - I f{x) cos nx dx 

—X 

= ~[fix) sin sin na: dx 

1 f”" 

mrj - 

From Theorem 1 it foUows that 

sin nx dx 

is of order -7 so that 
n 


< 


M 


*F(n) is said to be of order ^ if |F(„)( < E independent 


of n. There are other definitions of the 
example, Whittaker and Watson, Modern 


phrase of the order 
Analysis, p. 11. 


of; see, for 
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This result can be extended readily to establish 
Theorem 2. If the function f{x) is periodic and has k — 1 deriva- 
tives in the interval —t ^ x Ax, and is such that its kth derivative 
satisfies the conditions of Dirichlet in the same interval, then the 
Fourier coefficients for f{x) satisfy the inequalities 

|a„i < and 16„| < 

where M is a positive number independent of n. 

It should be noted that the requirement that the derivatives 
of the function /(a:) exist implies the continuity of the function. 
Moreover, since fix) is continuous in the interval — x A a: < x, 
the periodicity condition requires that/(— x) = /(x). 

An important conclusion follows directly from Theorem 2. 
Consider a periodic function fix) which is continuous in the 
interval (— x, x) and whose first derivative fix) satisfies the 
conditions of Dirichlet in the same interval. The Fourier 

series for such a function has coefficients of order so that 


|/(a;)| = (a„ cos w + sin nx) 


jun cos nx + hn sin nx\ 

M 


where M is a positive number independent of n. 

This inequality states that the terms of the Fourier series 
are numerically less than the corresponding terms of a convergent 
series of positive constants. Hence, the series 


Six) = ^ 
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converges uniformly* in the interval (— tt, tt). Accordingly, 
the Fourier series for a function v^hose derivati-ve satisfies the 
Dirichlet conditions can be integrated term by term. 

It is obvious that the differentiation of a trigonometric series 


{cLn cos nx + bn sin nx), 


term by term, produces a trigonometric series whose coefficients 
are of the order of nan and nbnj so that the differentiated series 
will converge less rapidly if at all. For example, the series 
resulting from term-by-term differentiation of the seriesf 
representing the function /(:r) = x, (—tt < x Tr)^ 


(108-3) 


2^sin X — 


sin 2x sin 3x 
~2 ^ ~ 3 ~' 


IS 


2(cos X — cos 2x + cos So? — • * • ), 

which diverges for all values of x. 

On the other hand, term-by-term integration of the same 
series between the limits 0 and x gives the series 


S(x) = -2 


cos X 

cos 2x 

cos 

cos 3x 

X 

. 

cos X 

“2^ 

cos 2x . 

0 


22 + 

3" 



) 


} 


+ 2l 1 2^ 3® 


Butt 


12’ 


so that 




* See Sec. 71. 

t See Example 1, Sec. 104. 
X See Prob. 5, Sec. 104. 
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which is precisely the Fourier series for %r in the internal 

2t 

“X S. X S X.* 

Now despite the fact that the series (108-3) does not converge 
uniformly, the term-by-term integral of this series con\^erges 
to the value of the integral of the function defined by (108-3). 
This is not an accident, and it is possible to prove that whenever 
S{x) is represented by a Fourier series, so that 


cos nx 


then 

j /(a:) dx 

In other words, the Fourier series representing f{x) can always 
be integrated term by term regardless of whether the given 
series converges uniformly or not.f 

However, great care must be exercised in differentiating the 
trigonometric series term by term. If f{x) is periodic and 
continuous in the interval — x < re x, and its derivative of the 
second order satisfies the Dirichlet conditions in the same 
interval, then the Fourier coefiScients of f{x) will be of order 

~ The series obtained by differentiating the Fourier series 

for f(x) win have coeflSicients of order and consequently it 

will converge uniformly. Under such circumstances the term- 
by-term differentiation is clearly legitimate. 

109. Fourier Integral. The theory developed in Sec. 106 
permits one to write the Fourier series of a function /(a;) which is 
defined in the interval (— Z, Z), where I is finite but can be made 

* See Prob. 1, Sec. 104. 

t Tbe proof of this remarkable fact will be found in a paper by E. W 
Hobson in the Journal of the London Mathematical Society , vol. 2, p. 164, 1927, 
See also C. J. de la Vall4e Poussin, Cours d’analyse infinitesimale, vol. 2. 




Uo 


2 + 2 /.' 


(an cos nx + hn sin 7ix) dx. 
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as large as desired. The limiting form of the series (106-2), 
when Z is allowed to increase indefinitely, can be written in the 
form of an integral. It will be assumed here that the function 
f{x) satisfies the conditions of Dirichlet in any interval ( — Z, Z), 
where I can be made as large as desired, and that the integral 

dx 


converges. 

Since f{x) is assumed to satisfy the conditions of Dirichlet* 
in any interval (~Z, Z), it follows that 

(109-1) fix) = I 
where 



Substituting these values of the coefficients in (109-1) gives 
(109-2) 7 


cos 


sm 


nTxy 



I dx is assumed to be convergent, 


dt\ 


dt 


^ 21 


which obviously tends to zero as Z is allowed to increase indefi- 
nitely. 

Now, if the interval (— Z, Z) is made large enough, the quantity 

TT 

j which appears in the integrands of the sum, can be made as 

small as desired. Therefore, the sum in (109-2) can be written 
as 


If /(i) is not continuous at the point x = Xo, then the left-hand member 
of (109-1) means }4\f( 
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(109-3) 


where 


if. 

- Aa 1 
J 

( fit) COS Aa(i — x) dt 

+4«J 

-L * . 

[ f(t) COS 2Aa{t — x) dt 

+AaJ 

[ f(t) cos nAa(t — x) dt 

+ • • 

'■ 1 


A ^ 

Aa = Y' 


This sum suggests the definition of the definite integral of 
the function 


F{a) = cos a(f — x) dtj 

in which the values of the function F{a) are calculated at the 
points 

TT 27r Stt 

r T T 

Now for large values of I 

cos a{t — x) 


differs little from 


cos a{t — x) dt, 


and it appears plausible that as I increases indefinitely the sum 
(109-3) will approach the limit 

- I da \ f(t) cos a{t — x) dL 
0 J — «> 

If such is the case, then (109-2) can be written as 


(109-4) f(x) 




f{t) cos ait — x) dt. 
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The foregoing discussion is heuristic and cannot be regarded 
as a rigorous proof that /(a:) is capable of the integral representa- 
tion (109-4). However, the validity of the formula (109-4) 
can be established rigorously,* if the function f{x) satisfies the 
conditions enunciated above. The integral (109-4) bears the 
name of the Fourier integraL 

The formula (109-4) assumes a simpler form if f(x) is an even 
or an odd function. Thus, expanding the integrand of (109-4) 
gives 


(109-5) fix) 



cos at cos ax dt 



sin at sin ax dt. 


Now if f{i) is an odd function, then the function f{t) cos at will 
be also odd. Therefore, for an odd function f{x), (109-6) 
reduces to 


fit) sin at sin ax dt, 

since the first integral in (109-5) vanishes. Moreover, since 
fit) sin at is an even function when fit) is odd, the foregoing 
integral can be written as 

(109-6) fix) — ^ fit) sin at sin ax dt. 

An entirely similar argument proves that if fix) is an even func- 
tion, then 

(109-7) fit) cos at cos ax dt. 

'l^fix) is defined only in the interval (0, tt), then either (109-6) 
or (109-7) can be used, since the function fix) may be thought 
to be defined in the interval (— tt, 0) so as to make it either even 
or odd. However, it must be remembered that at the points of 
discontinuity the integrals in (109-6) and (109-7) converge to 
M[/(^o+) + fi^o — )]t so that for x = 0 the formula (109-6) 
will always give the value 0. 

* See Carslaw, H. S., Fourier's Series and Integrals, p. 283. 
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PROBLEMS 

1, Set f(x) == e-^ in (109-6) and show that 


2. Take 


I * q: sin oix - ir 


fix) = 1, if 0 :S X < 1; 

= 0, if X > I 


and show, wdth the aid of (109-7), that 


/• 00 . 

j sm c 

Jo Oi 


cos ax ^ TT _ ^ ^ 

- da = -J if 0 X < 1; 


if 


= 0, if X > 1. 

3. Show, with the aid of (109-6) and (109-7), that 


: sin ax 


f* 00 

f 

Jo 


Six) 


cos ax 


= — if /3 > 0. 


4. Show that the Fourier integral can be \\T:itten in the form 


5. Consider the equations 


and 


/(x) cos xt dx == F{f) 



sin xt dx = ^ it 


where F{x) and ‘i>(x) are known functions and /(x) and ^(x) are the 
functions to be determined. The equations in which an unknowm func- 
tion appears under the integral sign are called integral equations. Show 
with the aid of (109-6) and (109-7) that 


^Jo 


F{t) cos xt dt 
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and 


4>(0 sin xt dt 


are the solutions of the given integral equations. Note particularly the 
remarkable form of these solutions- The integral equations of this 
problem are called the integral eqimtiom of Fourier, 
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IMPLICIT FUNCTIONS 

110. A Simple Problem in Implicit Functions. The purpose of 
this and the next two sections is to present a simplified formal 
treatment of some of the important problems arising in the 
theory of implicit functions. These problems are investigated 
in some detail in the subsequent sections where sharper definitions 
and restrictions on the type of functions to be considered are 
supplied. 

A simple instance of an implicit functional relationship is 
that of the form 

(110-1) F{x, y) = 0, 

where, corresponding to a certain range of real values of x, 
the equation (110-1) defines a set of real values of y. In particu- 
lar, let (so, j/o) be a pair of values which satisfy (110-1), so that 

F{x^, j/o) = 0, 

and denote the totality of values of y, corresponding to a given 
range of values of x in the %dcinity of x = xo, by 

(110-2) y=j{x). 

A question of practical importance vill be considered next. 
Under what circumstances can one obtain a solution of (110-1) 
in terms of x in the neighborhood of (xo, j/o)? If the function 
/(x) can be expanded in Taylor’s series about the point x = xo, 
then 

(110-3) y = /(x) =/(a:o) +f(a:o)(a: - xo) + • • • 

The coefficients (^ = !> 2, • • • ), appearing in (110-3) 

can be calculated from the known relationship (110-1) by the rule 
for differentiation of implicit functions. 

415 
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The differentiation of (110-1) with respect to x gives 
dx ~ dy dx 

and, if 5^ 0 at the point (zo, ya), then 

dx! 


The value of f'{x) at x = xo can be calculated from the formula 


(110-4) 


§y = 

dx Fy(x, yY 


which implies that Fy does not vanish in some neighborhood 
of the point (xo, y^. Then 


(110-5) 


dx" 




F XX + Px 



and making use of (110-4) leads to the formula 


(110-6) S = - ^3 

provided that the inversion of the order of differentiation is 
legitimate.* 

The formula (110-6) can be used to calculate the/''(a:o) appear- 
ing in (110-3), since the values of the second partial derivatives 
at the point (2:05 2/0) can be calculated from the given function 
F(x^ y). The value of at x = Xo can be calculated with 

the aid of (110-6), and so on. In this manner one can construct 
the solution of (110-1) for y in the neighborhood of the point 
((Co, 2/0) in the form (110-3). The essential feature of this dis- 
cussion is the requirement that F^(Xj y) does not vanish in the 
vicinity of the point (a:o, 

As an illustration of this approach to the problem of implicit 
functions consider the task of obtaining the solution of 

5 , 


* See Sec. 31. 
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which is valid in the vicinity of the point (2, 1). Noting that 


2 x + 2 s ,|.0 


gives 

(110-7) 


dx 


X 

y 


( 110 - 8 ) 


dx^ 


Differentiating again gives 

y - y'x ^ 

where the last step is obtained by substituting the expression 

d^y 

for y' from (110-7). The expression for — can be calculated 
from (110-8); thus, 


±y3_ 

Obviously, the process of successive differentiation can be 
continued, in this case, as many times as desired. Substituting 
a; = 2 and y = lin the formulas for the derivatives just obtained 
gives 

f{2) = -2, r{2) = -5, r'(2) - --30, 

so that the solution (110-3) becomes 

(110-9) y = l-2ix-2)- ^(x - 2y - |5(a: - 2)^ 

‘ • 

Of course, the solution of 

X- + ?/- = o, 

in the vicinity of the point (2, 1), could have been obtained by 
elementary algebra to give 

which upon expansion in the series of powers of a: — 2 will yield 
the infinite series (110-9). 
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111. Generalization of the Simple Problem. The discussion of 
Sec. 110 may be generalized in two directions: 

(a) A greater number of variables may be introduced in the 
functional relationship (110-1); 

(5) The number of functions may be increased. 

As an instance of the generalization of the first type, consider 
a relationship of the form 

(111-1) F(x, y, z) = 0, 

and assume that corresponding to a certain region of values of x 
and y in the neighborhood of the point (xq, yo) the equation 
(111-1) defines the function z, say 

(111-2) z = f(x, y). 

It is understood that (111-2) is such a solution of (111-1) that 
F{xo, 2/0, So) s 0. 

Assuming, as in the case of the simple problem treated in 
Sec. 110, that fix, y) can be expressed in the form of Taylor's 
series, namely, 

(111-3) z = fix,, yo) + (^^^^ix - xo) + - yo) 

+ • • • , 

one can calculate the partial derivatives entering in (111-3) 
from (111-1). Thus, 


dF = 0 — ~ dx + — dy + — dz, 
dx dy ^ dz ’ 


and since x 
follows that 

and y 

are assumed to be independent variables, it 



dF 

dF 

(111-4) 


dx 

dz dy 

dx 

dF ’ 

dy~ ^ ' 



dz 

dz 


iiiiless vanishes in the neighborhood of (xo, yo, 2o). 

The substitution oix = xo,y = yo, z = 2 o in (111-4) yields the 
coefficients of the linear terms appearing in (111-3). The 
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coefficients of the higher powers of x — xo and p — po can be 
calculated successively with the aid of the formulas (111-4). 

dF 

Again, it should be noted that it is necessarv- to demand that V 

" oz 

does not vanish in some neighborhood of the point (xo, pc, zq), 
if the formulas (111-4) are to have a meaning. 

As an example of the generalization of the second type, con- 
sider a pair of equations 


(111-5) 


'F{x, p, u, v) = 0, 
G{x, p, u, v) = 0, 


which connect four variables x, y, u, and v. Let it be assumed 
that there exists a set of four real numbers aro, yo, wo, i’o such that 


and 


Fixo,yo, = 0 , 

G{xo, po, 0. 


Further, suppose that the equations (111-5) can be solved in the 
\dcinity of the point {xq, po, uq, va) to yield 


( 111 - 6 ) 


(u = f(x, y), 
= gix, y), 


w'hich are so chosen that 


(111-7) 


= /(a:o, 


If the functions Six, y) and gix, y) possess sufficiently good 
properties to admit of power-series expansion in the neighborhood 
of the point (a;o, yo), then one can write 

“ = /(^o, Po) + - Xo) + (^^iy - yo) 

+ “ * * y 

t; = gixo, yo) + (^ix - xo) -f ( 1 )^( 2 / - yo) 

+ • • • . 

The values /(a:o, yo) and gixo, yo) are known, since the left-hand 
members of (111-7) are prescribed in advance. The coefficients 
of the linear and higher powers of a; — xo and y — yo can be 


( 111 - 8 ) 
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determined by the differentiation of equations (111-5), where 
u and V are regarded as functions of the independent variables 
X and y. 

Thus, differentiating equations (111-5) with respect to x 
gives 

dx du dx dv dx ^ 

BG , BG Bu , BG By __ ^ 

Bx Bu Bx Bv Bx 


Solving this system for ^ and ^ by Cramer’s rule provides 

oX uX 


Bx 

Bx \BF 
\Bu 

Bu 

Now, if the denominator 


(111-10) J 


does not vanish for (ajo, yo, 
dx/ \dx/o 






dv 


du 

dx 



dG 

dG 

dv 

Bv 

du 

dx 


Bx 

dF 


dv 


du 

dv 



dG 


dv 


du 

dv 


dF 

dF 

du 

dv 



du. 

dv 


, Vo), the values of 



can be calculated from (111-9). Similarly, the differentiation of 

equations (111-5) with respect to y will yield formulas for — 

By 

aiid — which are analogous to (111-9) and which contain the 

same determinant J in the denominator. 

The coefficients of higher powers of x ^ Xa and y — yo in 
(111-8) can be calculated with the aid of the expressions for 
the first partial derivatives. It is obvious that the success of 
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this scheme depends on the nonvanishing of the determinant 
(111-10) in the neighborhood of the point {xo, yo, uo. Vq). 

An entirely similar consideration of the set of three equations 

( F(x, y, z, u, V, w) = 0 , 

(111-11) I G(x, y, Zj u, V, w) = 0, 

{H(x, y, z, u, V, w) = 0 , 

shows that the determinant 

dv dw 

dv dw 

dv dw 


( 111 - 12 ) 


du 

dG 

du 

m 

du 


plays the same role in the problem of solving (111-11) for u, 
V, and w in terms of x^ y, and z as (111-10) did in the simpler case. 

The determinants of the form (111-10) and (111-12) are called 
Jacobians, and they are fundamental to all of the investigations 
of this chapter. 

A particular form of the functional relationship (111-5) is of 
frequent occurrence in geometry. Let 


(111-13) 


fx = (p(Uj v), 

\y = v), 


be regarded as the equations of transformation which establish a 
relationship between a set of points of some region of the a: 2 /-plane 
with the corresponding set of points in the ut;-plane. It will be 
assumed that there is a one-to-one correspondence of the points 
of the region in the a^^z-plane with those of the wt;-plane. Let 
it be required to obtain from (111-13) the inverse transformation, 
namely, 


(111-14) 


= fix, y), 
» == gix, y). 


The equations (Hl-13) can be put in the form (111-5) by 
writing them as 

Fix, y, u, v) = ipiu, v) - X = 0, 

Gix, y, u, v) = if-Cw, v) - y = 0. 



422 


ADVANCED CALCULUS 


§111 


Hence, if the scheme outlined above is to be available for the 
calculation of the inverse transformation, it is necessary to 
demand the nonvanishing of the determinant 


(111-15) 


It is clear that a similar consideration applied to a set of n 
equations of transformation of the form 


(111-16) ’ ^ 

will lead to a consideration of the determinant 


(111-17) 


dui 

dui 


dui 

dxi 

dX2 


dXn 

dU2 

dU2 


SU2 

dXi 

dX2 


dXn 

dUr, 

dUn 


dUn 

dxi 

dX2 


dXn 


It is interesting to note that if the equations of the transformation 
(111-16) are linear, so that 

Ui = aaXi + ai2X2 -j- • • • -[- ainXnj (i = 1, 2, • • • , ?^), 

then (111-17) is precisely the determinant of the coefficients 
of the 2 ;^s, namely, 


an 

Ui2 . . 

• • a^in 

a2i 

U 22 • - 

• • a2n 

a^i 

anz . . 

. . a^n 



§112 


niPLIClT FUNCTIONS 


423 


and it is well known that in obtaining the solution for the vari- 
ables Xi in terms of the Ui, it is necessary to demand the non- 
vanishing of the determinant A. 

112. Functional Dependence. Another important problem 
arising in the study of implicit functions is that of the functional 
relationship that may exist among a set of functions. As a 
simple example of such a circumstance, consider a pair of real 
functions 


( 112 - 1 ) 


= 9ix, y), 


of the variables x and defined in some region R of the x?/-plane. 
It will be supposed that the functions u and together with 
their first partial derivatives, are continuous in R. Further, 
suppose that there exists a functional relationship between the 
functions u and v of the form 


(112-2) F{u, v) = 0, 

such that 


(112-3) y)] ^ 0. 

The identity sign in (112-3) means that the left-hand member of 
(112-2) annuls itself for all values of x and y in the region R 
when /(a;, y) and gix, y) are substituted for ii and v, respectively. 
Differentiating (112-2) with respect to x and y gives 


(112-4) 


dF du dF dv 

du dx dv dx 

dF du dF d v 

du dy dv dy 


The equations (112-4) may be looked upon as a set of two homo- 

X- • ^ A- dF .dF 

geneous linear equations in — and — • JNow — and — cannot 

both vanish identically in R, since this would imply that F(u, v) 
is independent of u and v. Consequently, if is to be a function 
of u and v, then the system (112-4) must possess nonzero 
dF dF^ 

solutions for — and — ; hence, the determinant of the coeflScients 
du dv 


. dF 1 dF -i 
of — a-Did namely 
du dv 



424 


ADVANCED CALCULUS 


§112 


du 

dv 

dx 

dx 

du 

dv 




must vanish for all values of x and y in the region B. These 
considerations can obviously be extended to cover the case of a 
set of n functions x^, - , Xn) of n independent variables 

Xl, X2j * , Xn. 

It appears from this formal investigation that the vanishing 
of the Jacobian is a necessary condition for the existence of a 
functional relationship among a set of n functions , 

Xn)y and it will be shown rigorously in Sec. 115 that this condition 
is both necessary and sufficient. 

As a specific illustration of the foregoing consider the set of 
three functions 

(u ^ X + y + z, 

(112-5) = xy yz + xz, 

(tc? = + 2/' + 

It is easily checked that 

F{Uj V, w) ^ — 2v — w — 0. 

The Jacobian of (112-5), namely, 

[I y + z 2x\ 

1 X + z 2y 0 

1 y + X 2z\ 


as it should be. 

On the other hand, the relations 


give 


u = — 

V = 2xyj 


2x 2y 

J = 


\-2v 2x\ 
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which ob\aously does not vanish identically in any region R, 
so that u and v cannot be connected by means of any analytic 
relationship of the form F{u, v) = 0. 

113. Existence Theorem for Implicit Functions* It is the 
purpose of this section to furnish a rigorous discussion of the 
problem which was treated formally in Sec. 110. Let F(x, y), 
regarded as a function of two independent variables x and y, 
be such that for x = xq and y — yo 

Vo) = 0. 


Consider a rectangular region (Fig. 89) bounded by the lines 


X = xq ± h, 
y = yo ± kj 

and suppose that correspond- 
ing to every value of x in the 
interval (a;o — A, rro + h) there 
exists one, and only one, value 
of y l3dng in the interval 
(yo -- kj yo + k) such that 

(113-1) F{x, y) = 0. 



Fig. 89, 

Under these circumstances 

the equation (113-1) is said to define y as an implicit function 
of X. If this function be denoted by the symbol 


then 

2/0 = /(a^o), 

and the latter is called the solution of (113-1) for y in terms of 
X at the point {xq, yo). 

The following existence theorem is of fundamental importance 
in all considerations of this chapter. 

Theorem 1. Let xo he any real value of x such that: 

(а) F(xo, y) = 0 has a real solution ^o, that is, 

F(xo, yo) = 0 ; 

(б) F{x, y), regarded as a function of two independent variables 
X and y, is continuous and has continuous partial derivatives 
Fxix^ y) and Fy{x^ y) in some region R enclosing the point (xo, yo); 



426 


ADVANCED CALCULUS 


§113 


(c) Fyixo, yo) 9^ 0; 

then Fix, y) — Q can he solved {theoretically) as y = fix) in the 
vicinity of x = Xq in such a way that 

yo = fixo). 

Moreover, the solution is unique and is such that y = fix) has a 
continuous derivative in the vicinity of x = Xo which is given by the 
formula 


fix) 


Fxjx, y) 

Fyix, y) 


Since Fix, y) is assumed to be continuous in some region 
containing the point {xa, yo), the function Fixo, y), obtained 
from Fix, y) by setting a: = a;o, is a continuous* function of y. 


dF 

Furthermore, — 0 at {xo, yo), so that the function Fixo, y) 

is increasing in the vicinity oi y = yo if Fyixo, yo) > 0, and is 
decreasing if Fyixo, yo) < 0. But Fixo, yo) = 0; hence, the 
function Fixo, y) must change sign at y = yo. For definiteness 
let Fyixo, yo)l> 0; then there exists an interval {yo — 5, j/o + 5) 
such that the function Fixo, y) is negative for all values of y 
such that 


j/o - 5 y <yo, 

and is positive whenever 

yo < y ^ yo + s. 

Furthermore, Fix, yo — d) and Fix, yo + S) are continuous 
functions of x, and for x = xo the function Fix, yo — 5) is nega- 
tive. Consequently, there exists some interval {xo — F,xo-{- F) 
about the point x = xo such that Fix, j/o — 5) < 0 for all values 
of a: in this interval. 

Similarly, Fixo, yo f h) > 0, so that in a sufficiently small 
interval about the point x = xo. Fix, yo + 5) will be positive. 
Let this interval be {xo - 5”, xo -f 5"), and if Si is the smaller 
of the two numbers S' and S", the functions Fix, yo — S) and 
Fix, yo + 5) will have opposite signs for all values of x that are 
interior to the interval {xo — Si, xo + Si) (Fig. 90). 


See Sec, 22. 
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Let X == xihe any value of x in the interval {xo - oi, Xq + di) ; 
then, since F(xu yo — B) and F(xi, yo + 5) are of opposite signs, 
there will be some value of y, say y = yi^ where 

yo - B <yx<yQ + b, 

such that 

(113-2) F{x^, yO = 0. 

The value of y satisfj^dng (113-2) depends upon the choice of x, 
and, since for each value of x that is interior to {xq — Bi, Xq + Bi) 



there is determined a value of y satisfying F{Xj y) = 0, one can 
write 


y = 

The continuity of y = /(x) in the vicinity of a; = xo follows 
from the fact that for all values of x in the interval (xo 5i, 
^0 + 5i) the equation 

F{x, 2 /) = 0 

has a solution y = f(x), for which y lies betw^een yo — B and 
2/0 + 5 . 

At this stage of the proof one cannot assert that there is but 
one value of y corresponding to the choice x — Xi. In order 
to establish the uniqueness of the solution, the hypothesis of 
the continuity of y) in some region enclosing the point 
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(so, yo) will be utilized. If F^ix, y) is continuous in the vicinity 
of (xo, 2 / 0 ) and is different from zero at {xo, yo), then it will be 
different from zero at all points sufficiently near (xo, yo). Now, 
if in the foregoing discussion 5 and 5i are chosen so small that 

: 0 when \x — xo\ < and \y — 2 / 0 ] < S, 

then the function 

F{xi, y), where — 5i < < a:o + Si, 

vnll be either increasing or decreasing for all values of y in the 
interval {yo — S, 2/0 + S). Under these circumstances F{xi, y) 
cannot vanish for more than one value of y. 

In order to establish the continuity of the derivative of 
y = fix:) in the vicinity of 2 : = xo, let (x + Lx, y + At/) and 
{x, y) be a pair of solutions of Fix, y) = 0. Then 

F{x Ax, 2 / + At/) — F{x, 2 /) = 0 

and, obviously, 

Fix + Ax, y + Ay) Fix + Ax,y)+ Fix + Ax, y) 

- Fix, y) 0. 

By hypothesis F*(x, y) and Fyix, y) are continuous functions 
in some region R about (xo, yo). Therefore, from the mean- value 
theorem, * it follows that 

AyFyix -t- Ax, 2 / + Si Ay) -f AxF^ix -f- S 2 Ax, y) = 0, 

where 0 < Si < 1 and 0 < S^ < 1. Solving for ^ gives 

^ + S 2 Ax, y) 

Ax Fyix + Ax, y + Si Ay) 

and, letting Ax 0, one obtains 

^ y) ^ 

dx Fyix, y)’ 

since F yix, 2 /) 7 ^ 0 for every point (x, y) in the region R. 

If the assumption of the continuity of jPi(x, y) is abrogated, 
one cannot assert that the solution y — fix) will possess a con- 

* See Sec. 20. 
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tinuous derivative in the vicinity of a: = xq. However, the 
solution y = f(x) viil be unique and continuous under the 
hypothesis that Fy{x, y) is continuous in the neighborhood of 
(xo; yo) and is different from zero at the point (xo, 2/0). It is 
not difficult to demonstrate the existence of a unique solution 
on the hypotheses that Fy(xo, y^) is different from zero and 
Fy{x, y) does not change sign in the vicinity of (xo, 2/0).* 

An argument in every respect similar to the foregoing permits 
one to generalize Theorem 1 to include the case of functions 
of more than two variables. Thus, one can enunciate the 
follovdng theorem: 

Theorem 2. Let the function F (xi, X2, • • • , Xm, u) satisfy the 
following conditions: 

(a) F(xi, X27 • • • , Xrrj,, u) has a real solution for Xi = xj, 

^2 = 2:1, • • • , x«x = xl,] 

(b) F(xi, X2, • • • , Xm, u)f regarded as a function of them + 1 
independent variables Xi, X2, • • • , Xmj u. is continuous and has 
continuous partial derivatives Fsu Fx^, • • • ? F« in soine region 
of space enclosing the point (xj, x|, • * • , x^, u^) ; 

(c) Fu(x?, xl, • • • , xL u^) 0. 

Then F{xi, X2, « • • , x^, u) = 0 can be solved in the vicinity of 
(xl xl, • - • , xi) to yield 

,U — f(Xij Xrn) 

in such a way that 


The solution u — f(xi, Xo, * * • , Xm) is unique and is continuous 
in the vicinity of the point (xj, x§, • • • , x^) together with its first 
partial derivatives, which are given by the formulas 

du Fxi(xij x%, ’ * * j Xttij 2/)^ 

F %t(jxxj X2, j Xjfij u) 

F u{X\, X2, mj U) 

• ‘ J 

du 22 ^ 


* See Hobson, E. W., Functions of a Real Variable, voL 1, Secs. 316, 316h 
pp. 432-436. 



430 


ADVANCED CALCULUS 


§114 


114, Existence Theorem for Simultaneous Equations. 
Theorem. Let a system of n equatio7is 

(114-1) Fi(Xlf X^j * * * j * * * > 'W-n) 0, 

(2 = 1, 2, * • • ) 7 l ), 

in m + 71 variables xi, 2 : 3 , • • • , x^, Ui, , Un have a 

solution xl, xlj ' • ' ; x^j u?, ul, • • ^ , u^, so that 

(114-2) Fi(xij xl, * * • 5 x^y Uij j "^n) ~ 0, 

(z = 1, 2, • • • , n). 

If the functions 


regarded as functions of m + n independent variables, are con- 
tinuous and have continuous first partial derivatives in some region 
R of the m + n dimensional space enclosing the point P, whose 
coordinates are (xl, xl, • • • , x^, ul, ^ , u^, and if the 

Jacobian 


' 2 2 


,F„) 

dU2 

dUr,' 


\ dFn 

dFn\ 


U dU2 

du, 


is different from zero at the point P, then the set of equations (114-1) 
can he solved as 

(114-3) Ui = fi(xi, X 2 , • • ‘ , x,n), (i = 1, 2, ‘ , n), 

in the vicinity of the point P in such a way that 

= fii^i: xl, ^ ^ , xl^, (^ = 1 , 2 , • • • , n). 

Moreover, the set of solutions (114-3) is unique and the functions 
Ui are continuous together with their first partial derivatives in 
the neighborhood of the point (cc?, • • • , a:^). 

This theorem has been established in Theorem 2 , Sec. 113, 
for the case wheii = 1 , in which the Jacobiai^ reduces to Fuy 
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It is natural to extend this proof to a greater number of functions 
by mathematical induction. Thus, if the correctness of the 
theorem can be established for n functions on the hypothesis 
that the theorem is true for n ~ 1 functions, then the truth of 
the theorem follows for 7i = 2, 3, 4, • - • , since the theorem 
is known to hold for n = 1. 

By hypothesis the determinant J does not vanish for the 
particular set of values (x?, xS, • * • , u\, ul, — • , 

so that all of its elements cannot be equal to zero. Let it be 
supposed that it is the partial derivative 

dK 

SUn 

appearing in J, that does not vanish.* Then it follows from 
Theorem 2, Sec. 113, that the equation 

(114-4) Fn{xi, Xo, * * * , Xm, Ui, W2, • • * , lu) = 0 

can be solved to ;>ield 

(114-5) lin “ ^(^1; * * * j Xmj 'Wl, * * * j 'Wn— l), 

in such a way that 

Wn = xl ’ • • , xi, ul • * * , wLi)- 

Substituting (114-5) in the first n — 1 equations of the set 
(114-1) gives 

(114-6) 1, X 2 , * * * j Xmj Tiij '11-2} * * j 1 ) 

(^ = 1, 2, • - • , n ~ 1), 

where 

(114-7) #i(xi, xo, • * • , Xm, Uh tio, * * • , Un^l) 

= Fi(X\f Xo; * * * J Xm.) Uij 712) * ’ * j TLn—i^ <p)* 

Equations (114-5) and (114-6) are equivalent to the system 
(114-1). Now^ if the n - 1 equations (114-6) can be solved for 
Ul, U 2 , * • ’ , Un-i in terms of Xi, X 2 , * • * , there will be 
obtained a set of u “■ 1 functions 

(114-8) Ui = /i(xi, X 2 j • ' ' i Xm), (f = 1, 2, • * ‘ , n — 1). 

* By reordering the functions (114-1), if necessary, it is always possible 
to achieve this, 
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Substituting from (114-8) in (114-5) gives 

(114-9) Wn = /n(Xi, Xi, ■ ■ • , Xm). 

The set of n functions (114-8) and (114-9) is the desired set 
(114-3). But the set of n — 1 equations (114-6) is of the type 
(114-1), and if it is assumed that the theorem is valid for n — 1 
functions, then Eqs. (114-6) can be soh’-ed for Ui, u^, 
in terms of Xi, x-i, ■ ■ ■ , x^, provdded that 


^(Wl, W 2 , " * * j — 1 ) 

for (xj, xl, ■ ■ ■ , xi, w?, ul ■ ■ ■ , mLi). 

In order to show that A does not vanish it is desirable to write 
it out explicitly. From (114-7) it follows that 



dFi 

, SFi 

d<p 

dFi 

-4- 

dFi 

dtp 

dFi 


BFi 

dtp 

dui 

r ^ 

dUft, 

dui 

dU2 


dUn 

dU2 

dUn-l 


BUn 

BUn-^l 

dFo 

dF 2 

d<{> 

dF 2 

_L 

BF 2 

B(p 

BF 2 

-U 

BF 2 

dtp 

dui 

^ dUn 

Bui 

dUi 


dUr, 

dU2 

dUn-^l 


BUn 

BUn~~l 

dPn-l 

dF^ 

dtp 

eF„-i 

' 4- 


L B^ 

BFn-l 

1 

BF n~l 

dtp 

dui 

^ dUn 

dUi 

dui 


BUji 

Buz 

dUn-1 

i- 

BUn 

BUn-1 


Since each element of this determinant is made up of the sum of 
two terms, A can be expressed as the sum of 2”“^ determinants. * 
Some of these 2"“^ determinants will contain two columns that 
are proportional, so that they will vanish, and the remaining 
ones give 


(114-10) A = -i- 

5 (Ml, M2, • 

d{Fj,Fi, 
SUn — 1 0(mi, 

* It wiU be recalled that 


+ 61 Cl ( 


<Zi Cl di 


&i Cl di 

Clz -f- 62 C2 1 


CLz C2 dz 

+ 

bz Cz dz 

+ &3 C3 < 


as C3 d^ 


bz Cz dz 
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The expressions for 


? d(p d<p 

i dU2 

which appear in (114-10), can be obtained as follows. Recalling 
(114-5) and applying the rule for the differentiation of implicit 
functions to (114-4), one finds 


OTn , OTn ^ 

dUi dUn dUi 

Hence, 


{i = 1,2, ■ ■ ■ ,n - 1). 


d(p 


On substituting these expressions for the ^ in (114-10) and 

C/ XL% 

dF 

multiplying both sides of the resulting equation by there 

uUn 

results 


dFn ^ d(_Fi, Fj, ■ ■ ■ , J’n-i) , ^ 

dUn 9(ui, Uz, ■ ■ ■ , w„_i) du„ 

d{Fu F„ ■ • ■ , Fn-i) . dF„ , _ . 

d{Un, Ui, • • ■ , Un-l) dUi 

djF 1, F«, • • • ; Fn—l) _ dF n 

, U„_2, Un) dUn-l 


A little reflection stows that the right-hand member of this 
equation is precisely the expansion of the Jacobian J in terms 
of the elements of the last row of J. Hence, 


A = 


J 


dFj 


which, by hypothesis, does not vanish at the point P. 

115. Functional Dependence. 

Theorem. LetUi = fi{xi,Xi, ■ ■ • ,a:„), (i=l,2, • • • ,n), 

he a set of n functions of n independent variables Xi, x^, ■ ■ ■ , Xn. 
The functions fi together with their first partial derivatives are 



434 


ADVANCED CALCULUS 


§115 


assumed to he continuous in some region B enclosing the 'point 
(xij xlf * , x^)^ A necessary and sufficient condition that 

there exist among these functions a relation 

F{Ui, U2, y Un) = 0 , 

which does not contain the variables Xij X2) , x^ explicitly, 

is that 


d{xi, X2, 

for all values of the variables Xi, Xo, • • • , Xn in the region R. 

In order to avoid complications in writing, the theorem will 
be established for the case of three functions 


(115-1) 


V = . 


y, 2 ), 


since the discussion of this case possesses all features of the 
more general circumstance. 

To demonstrate the necessity of the condition of the theorem, 
assume that the Jacobian 


(115-2) 





dfi 


dx 

dy 

dz 

d(u, V, w) 



df2 

d (x, y, z) 

dx 

dy 

dz 


dfz 

gz 

dU 


dx 

dy 

dz 


does not vanish at some point (o^o, ^o, ^o) of the region R, Denote 
the values of u, v, and w, calculated from (115-1) by setting 
X = xq, y = yo, z ^ by u^, v^, and It follows from the 
theorem of Sec. 114 that one can solve (115-1) to give 

X = (pi{u, V, w), 
y = ^2{u, V, w), 
z = (pz{u, V, w), 

where the solution is valid for an arbitrary choice of u, v, and w 
belonging to some region about the point {uq, vq, Since the 

choice of the numbers u, v, w is arbitrary, there can be no relation 
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F{u, V, w) = 0 

in the region U under consideration. 

To prove the sufficiency^ consider again the set of functions 
(115-1) and assume that (115-2) vanishes identically in the 
region i2. Consider first the case where at least one of the 
minors of J does not vanish identically, and assume that such a 
one is 


A = 


\dx 


dx 


dh 


Since A ^ 0 in i2, one can solve the first two of Eqs. (115-1) for 
X and y to yield 


(115-3) 


'x = ipi{u, V, z), 
y = <p 2 (u, V, 


Substituting these values in the third of Eqs. (115-1) gives 


(115-4) w = f3(<pi, <P2, = E(w, V, z). 

Now if the right-hand member of (115-4) contains no 2 , 
then w is a function of the variables % and v and this will establish 
the sufficiency of the condition for this case. It will be shown 
next that F(u, v, z) indeed is independent of s, since it will be 
proved that 


Calculating this partial derivative from (115-4) furnishes 


dz dx dz dy dz dz ' 

But, since (115-3) represents the solution of the first two of 
Eqs. (115-1), the substitution of (115-3) in the first two of Eqs. 
(115-1) yields the identities 
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<P 2 , z) are 


It is, therefore, evident that fi(<pi, ^ 2 , z) and 
independent of 2 , so that 


(115-6) . 

/ K/2 d(pi 

dy dz ' dz 

Adding to the last column of the determinant J the product 
of the first column by and the product of the second column 

by gives the determinant 




dfi d<pi 

J- 

dh 

d<p2 

-1- 

dfi\ 

dx 

dy 

dx dz 

1 

dy 

dz 


dz 

J = ^ 


dfi dipx 

+ 


d(p2 

+ 

dh 

dx 


dx dz 

dy 

dz 

dz 

dfz 


dfs d<pi 

+ 


d<p2 

+ 

dfz 

dx 

dy 

dx dz 

dy 

dz 

dz 


which, upon noting (115-5) and (115-6), reduces to 


J - A 


dz 


By hypothesis J ^ 0 and A 0, so that — ^ 0. 

oz 

It remains to consider the case where every minor of second 
order of the determinant J vanishes but where at least one of 
the elements of J does not vanish identically in R. Suppose, 
for example, that 



Then one can solve the first of Eqs. (115-1) for x in terms of y 
and 2 , so that 

X = y, z). 

Substituting this value of x in the last two of Eqs. (115-1) gives 

= hi'Pu y, 2 ) = F(u, y, z), 

, 2 ) = G{u, y, z), 
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and it remains to show that F and G do not contain y and 2 , 
in which event both v and w are functions of u. It will be proved 
next that such is the case. 

Now, 


dF d(pi . dfo 

dy 'to dy ^ dy' 

and from the first of Eqs. (115-1) it follows that 


^ 

to d y d y 


From these equations, and from the fact that every minor of J of 
order 2 vanishes, it follows that 


JF 


It can be verified in a similar way that 


dz 


dy 


and 


dz 


and hence, both v and w are functions of u. 

The remaining case in which every partial derivative vanishes 
identically is trivial, because in this event the functions w, v, 
and w reduce to mere constants. 

The extension of this proof to any number of functions is 
ob\dous. It may be remarked that, if the Jacobian of the n 
functions 


is such that every minor of order greater than r vanishes iden- 
tically while at least one minor of order r does not vanish, 
then there will be exactly n — r independent functional relations 
connecting the variables. 

Example, Let 


u — X + 2y + Zj 
V ^ X — 2y + z, 
w ^ x^ + 2xz — 42/^ + 
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Here, 


/ = 1 -2 1 = 0 , 


|2(rc + z) —Sy 2(z + z) 

so that the functions are dependent. Furthermore, since there 
exists a nonvanishing minor of second order, there is only one 
independent relation. In fact it is = w. 

116. Properties of Jacobians. Let there be a set of n functions 
Fi, F 2 , • • • , Fn of n variables Wi, 1 ^ 2 , • * • , and suppose 
that the variables U{ are not independent variables but are 
functions of some other set of variables Xi, x^, • • • , Xn^ Then 
it is easy to establish the folio vdng interesting formula: 


( 116 - 1 ) 


B{xi, 


1 


y Fn) j ttn) 

, Un) d{Xi^^a 


The result (116-1) follows upon multiplying the two deter- 
minants in the right-hand member according to the rule for 
the multiplication of determinants. * Thus, 


dFi 

dFi 

dFi 


dui 

dUt 

dUi 

dui 

dU2 

dUn 


dXi 

dX2 

dXn 

dFz 

dFz 

dFz 


dUi 

dUz 

dUz 

dui 

dlh 

dUn 


dxi 

dxz 

dXn 

dFn 

dFn 

dFn 


dUn 

dUn 

dUn 

dui 

dUi 

dUn 


dXi 

dXi 

dXn 


* ISTote that if the n-rowed determinant |a£y|, in which is the element in 
the tth row and the yth column, is multiplied by the n-rowed determinant 


|5£,-|, there results |a£,-| 
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gives the determinant whose element in the ith row and the jth 
column is 


dFj dill , dFi f . . . 

dui dXj du2 dxj ‘ dUn dXj 

dF ' 

The latter is recognized as the formula for — For n = 1, 

axj 

the formula (116-1) reduces to the simple formula for the deriva- 
tive of a composite function, namely, 

dx du dx 

Another interesting property of Jacobians is worth noting. 
Consider a transformation 

(116-2) Ui = fi(xi, 0^2, * • • , Xn), (i = 1, 2, • • • , ?2), 

and denote its inverse by 

(116-3) Xi = Zi2j * * * > 

The Jacobians of (116-2) and (116-3) are 


and 


Then, 


j 2*«) 


which, by the formula (116-1), is equal to 

diui, ihj • • • , Un) ^ 


Hence, the Jacobians of the direct and the inverse transforma- 
tions are reciprocals of one another. 

PROBLEMS 

1. If 

u = u(x, y, z), 

V = v{x, y, z), 
w = w(x, y, z), 
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assume that 9 ^ 0, so that one can solve the last two equations for 

5(2/, 

y and z. Substitute these solutions in the first equation, and show that 


du _ d{Uj V, w) d(y, z) 
dx d{Xj y, z) d(v, w) 


% Let 

X = x{u, v), 
y = yiu, v), 
z = z{u, v), 

be the parametric equations of a surface from which u and v can be 
eliminated to give z = F(x, y). Show that 


dx d(Uj v) * d{u, v) 

3. The transformation of inversion in space is given by 


u = 


V — 


y 

x‘^ + y'^ + 


w 


Does it possess an inverse? Verify that the product of the Jacobians 
of the direct and the inverse transformations is unity. 
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Coordinates, curtdlinear, 148 
cylindrical, 157 
polar, 148, 152, 157 
spherical, 157 
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D'Alembert's ratio test, 217 
Darboux theorem, 108 
Dedekind, 2, 3 

Definite integrals, 90-129 ' 

applications of, 126 
change of variables in, 124 
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mean-value theorems on, 113 
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of higher order, 87 
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partial, 62 
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of higher order, 47 
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tions, 45, 67, 71, 439 
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371 
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Directional derivative, 76, 86 
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Dirichlet's integral, 387, 362 
Discontinuities, 34, 392 
Divergence theorem, 167 


Double integrals, 130 
improper, 365 
Double series, 246 
convergence of, 247 

E 

e, base of natural logarithms, 28 
Ellipse, length of, 314 
Elliptic integrals, 117, 129, 312, 313, 
352 

Errors, approximate, 66 
relative, 66 
Euler’s formulas, 306 
Euler’s theorem, 75 
Evaluation of integrals, 110, 118, 
123, 131, 144, 178, 310, 357 
Even function, 391 
Exact differentials, 191, 199 
Existence theorem, for implicit func- 
tions, 425 

for simultaneous equations, 430 
Expansion, in Maclaurin’s series, 298 
in power series, 290, 291, 298 
in series of orthogonal functions, 
389 

in Taylor’s series, 298 
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Extended law of the mean, 291 
Extremal values, 327, 332 

F 

Factorial, generalkation of {see 
Gamma functions) 

Fermat’s theorem, 49 
Fluid motion, 204 

Force of attraction, 172, 202, 369, 
372 

Fourier coefficients, 380, 389 
Fourier integral, 409, 413 
equation, 413 
Fourier series, 362-414 
complex form of, 403, 405 
differentiation of, 405 
expansion in, 390 
integration of, 405, 409 
uniform convergence of, 408 
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FresneFs integrals, 365 
Function, 22, 58, 321 
bounds of, 106 
composite, 45, 47, 439 
continuity of, 31, 35, 39, 59, 392 
differentiable, 43 
even, 391 
homogeneous, 75 
implicit, 68, 415-440 
integrabie, 109, 110, 335n. 
jump in, 34 
multiple-valued, 22 
normal, 388 
odd, 391 
orthogonal, 388 
periodic, 379n. 
piece-wise continuous, 34 
sectionally continuous, 34 
single-valued, 22 
uniformly continuous, 38 
Functional dependence, 423, 433 
Functional determinant, 153, 157, 
167, 200, 421, 438 

Fundamental theorem of integral 
calculus, 110, 118, 120 

G 

Gamma functions, 372 
Gauss’s test for series, 230 
Gauss’s theorem, 169n. 

Geometric series, 214 
Gradient, 78 

Gravitational potential (see Poten- 
tial) 

Gravity, center of, 137, 159, 165 
Green’s theorem, 167, 170, 172, 181 

H 

Helix, 85, 86 

Homogeneous functions, 75 
Hyperbolic functions, 306 
Hyperbolic paraboloid, 325 


Implicit functions, 68, 415-440 
differentiation of, 71, 416 
existence theorem on, 425 
higher d'=^rivatives of, 89 


Improper integrals, 335-377 
multiple, 365 
Indefinite integrals, 119 
Indeterminate forms, 54 
Induction, mathematical, 9, 431 
Infinite integrals, 335, 347 
tests for convergence of, 341, 349, 
367 

(See also Improper integrals) 
Infinite series, 209-266 
absolute convergence of, 236, 240, 
263, 268 

addition of, 212, 240, 281 
alternating, 234 
of arbitrary terms, 233 
conditional convergence of, 236 
convergence of, 209, 233, 236 
differentiation of, 261 
division of, 285 
double, 246 
expansion in, 298, 383 
of functions, 247, 275 
geometric, 214 
integration of, 258, 309 
multipKcation of, 242,. 281 
of orthogonal functions, 389 
of positive terms, 233 
of power functions, 267-334 
algebra, 280 
applications, 291-334 
calculations with, 285 
expansion in, 291 
integration, 309 
reversion, 289 
tests for convergence, 269 
uniqueness theorem on, 279 
remainder in, 234 
sum of, 209, 395 

tests for convergence, 215, 225, 
237, 262, 269 

uniform convergence of, 247, 252, 
275 

(See also Fourier series) 
Infinitesimal, 64/1. 

Infinity, 16 

Integrabie function, 109, I 
Integral equation, 413 
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Integral test for series, 225 
Integrals, applications of, 126, 199 
change of variables in, 124, 147, 
155, 199 

containing parameters, 121, 353 
of Dirichlet, 387, 362 
definite, 99, 101 
differentiation of, 121, 353 
divergent, 335 

elliptic, 117, 129, 312, 313, 352 
evaluation of, 110, 118, 123, 131, 
144, 178, 310, 357 
of Fourier, 409, 413 
improper, or infinite, 335, 365 
(See also Improper integrals) 
indefinite, 119 
integration under sign, 353 
line, 174 

multiple, 130, 139, 142 
Riemannian, 104 
surface, 161, 196 
tests for convergence, 341 
transformation of (see Green's 
theorem; Stokes's theorem) 
uniform convergence of, 355, 367 
Integration, of Fourier series, 405 
under integral sign, 353 
hy parts, 353 
region of, 131 
in series, 309 
of series, 258, 309 

Interchange of order of differentia- 
tion, 87 

Intervals, Abel’s theorem on, 268 
of convergence, 248, 267, 269 
extension of, 401 
open and closed, 22 
Inverse transformations, 421 
Inversion transformation, 440 
Iterated integrals, 136 


Jacobians, 150, 153, 157, 167, 200, 
421 

properties of, 438 
Jump m function, 34 


K 

Kummer’s test, 228 
L 

Lagrange’s multipliers, 329, 331 
Lagrangian form of remainder, 292 
Laplace’s equation, 208, 372 
Law of the mean, 291 

(See also Mean-value theorem) 
Leibnitz’s theorem on series, 234 
Lemniscate, 128 
Length of curve, 127 
L’HospitaPs rule, 54 
Liapunoff, A., 383 
limiting points, 17 
Limits, 6, 16, 58 
existence of, 10 
of functions, 23 
iterated, 61 

left- and right-hand, 24 
repeated, 61 
theorems on, 26 
upper and lower, 16, 18 
Line integrals, 174-208 
applications of, 171, 199 
properties of, 185, 198 
in space, 195 

transformation of, 181, 196 
Logarithm, base of, 10, 28, 31 
Logarithmic spiral, 128 
Lower bound, 22, 23, 106 

M 

Maclaurin’s formula, 295, 318, 320 
Maclaurin’s series, 290 
Maxima and minima, 315, 321, 327, 
332 

Mean- value theorem, 51 

(See also Law of the mean) 
Mean-value theorems for integrals, 
113, 115, 131 
Mertens, F., 244 

Minima (see Maxima and minima) 
Minimax, 326 

Moment of inertia, 138, 145, 151, 
160, 166 
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Monotonicity, 14, 15 
Multiple integrals, 130, 139, 142 
improper, 365 

Multiplication of series, 244 
Multiply connected regions, 184, 192 

N 

Neighborhood, 8 

Newton’s law of attraction, 172, 202 
Newtonian potential, 172, 203, 370 
Normal derivative, 78, 86, 87 
Normal line, 80 

Normal orthogonal functions, 388 
Number system, 2 
Numbers, 1 
complex, 3 
rational, 1 
real, 2 


Odd function, 391 
Order of, 406 
Ordering, 1 

Orthogonal functions, 388 
Ostrogradsky’s theorem, 169n. 


Parameter, integrals containing, 121 
Partial derivatives, 62 
Partial sums, 209, 248 
Partition, 2 

Periodic function, 379n. 

Plane, tangent, 80 
Points of condensation, 17 
Polar coordinates, 148, 152, 157 
Potential, 172, 203, 206, 370 
Power series, 267-290 
applications of, 291-334 
Primitive, 119 

Principal part of increment, 64 
Probability integral, 357 


Quotient of power series, 282 


E 

Eaabe’s test, 230n., 233, 

Radius of convergence, 269 
Ratio test, 217, 220, 237 
Rearrangement of series, 240 
Regions, simply and multiply con- 
nected, 184, 192, 196 
Remainder, 234 
in Taylor’s series, 292, 293 
Riemann integral, 99 
upper and lower, 108 
Riemann zeta-function, 364, 365 
Rollers theorem, 50 
Root test, 216, 220, 237 


Schwarz’s theorem, 87 
Sequences, 3 
bounded, 5 
convergent, 6, 14 
divergent, 16 
limiting points of, 17 
limits of, 6 
monotone, 14 ’ 

null, 5 

Series (see Fourier series; Infinite 
series) 

Simply connected regions, 184, 196 
Simultaneous equations, existence 
theorem for, 430 
Sine and cosine series, 397 
Solid angle, 171 
Space curve, 83 
equation of tangent to, 85 
length of, 86 

Spherical coordinates, 157 
Spiral, logarithmic, 128 
Stokes’s theorem, 196 
Stream function, 206 
Summation of series, 395 
Surface integrals, 161, 196 
Surface of revolution, 128 


Tangent line, 70 
Tangent plane, 80 
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Taylor’s formula, 292, 293, 317 
applications of, 298, 322 
Taylor’s series, 296 
Tests, for integrals, 341, 349, 367 
for series, 215, 225, 237, 262, 264 
Total differential, 64 

[See also Exact differential) 
Transformation, of coordinates, 153 
of integrals, 167, 170, 172, 181, 
196 

of inversion, 440 

Trigonometric series [see Fourier 
series) 

Triple integrals, 142 
improper, 367 

U 

Undetermined multipliers, 328 
Uniform continuity, 37, 60 
Uniform convergence, of integrals, 
355, 367 

of series, 247, 262, 264, 408 


Uppir bound, 23 . 

. of function, 106 

V 

Velocity potential, 206 
Vicinity, 8 

Volume, element of, 156, 158, 159 
of revolution, 128, 143, 155 

W 

Wallis’s formula, 311 
Weierstrass test, for integrals, 355 
for series, 262 

Work, as a line integral, 201 

Y 

Young’s theorem, 89?i. 

Z 

Zeta-function, 364, 365 




